University of Leicester
V2-Spatial Sequential Recurrent Neural Network for HSI Classification.pdf (5.24 MB)

Spatial Sequential Recurrent Neural Network for Hyperspectral Image Classification

Download (5.24 MB)
journal contribution
posted on 2019-05-14, 10:41 authored by X Zhang, Y Sun, K Jiang, C Li, L Jiao, H Zhou
In hyperspectral image processing, classification is one of the most popular research topics. In recent years, research progress made in deep-learning-based hierarchical feature extraction and classification has shown a great power in many applications. In this paper, we propose a novel local spatial sequential (LSS) method, which is used in a recurrent neural network (RNN). Using this model, we can extract local and semantic information for hyperspectral image classification. First, we extract low-level features from hyperspectral images, including texture and differential morphological profiles. Second, we combine the low-level features together and propose a method to construct the LSS features. Afterwards, we build an RNN and use the LSS features as the input to train the network for optimizing the system parameters. Finally, the high-level semantic features generated by the RNN is fed into a softmax layer for the final classification. In addition, a nonlocal spatial sequential method is presented for the recurrent neural network model (NLSS-RNN) to further enhance the classification performance. NLSS-RNN finds nonlocal similar structures to a given pixel and extracts corresponding LSS features, which not only preserve the local spatial information, but also integrate the information of nonlocal similar samples. The experimental results on three publicly accessible datasets show that our proposed method can obtain competitive performance compared with several state-of-the-art classifiers.


This work was supported in part by the National Natural Science Foundation of China under Grant 61772400, Grant 61501353, Grant 61772399, Grant 91438201, and Grant 61573267 and in part by the joint fund of the Equipment Research of Ministry of Education. The work of H. Zhou was supported in part by the U.K. Engineering and Physical Sciences Research Council under Grant EP/N508664/1, Grant EP/R007187/1, and Grant EP/N011074/1, and in part by the Royal Society-Newton Advanced Fellowship under Grant NA160342.



IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018, 11(11)

Author affiliation

/Organisation/COLLEGE OF SCIENCE AND ENGINEERING/Department of Informatics


  • AM (Accepted Manuscript)

Published in

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing


Institute of Electrical and Electronics Engineers (IEEE)





Acceptance date


Copyright date


Available date


Publisher version