A spatial-spectral SIFT for hyperspectral image matching and classification

• Published in: Pattern recognition letters Vol. 127; pp. 18 - 26
• Main Authors: Li, Yanshan, Li, Qingteng, Liu, Yan, Xie, Weixin
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier B.V 01.11.2019; Elsevier Science Ltd
• Subjects: Algorithms; Classification; Color imagery; Feature extraction; HSI classification; HSI matching; Hyperspectral image; Hyperspectral imaging; Image classification; Image processing; Invariants; Matching; Robustness (mathematics); SIFT; Spatial data; Spatial-spectral feature; Spectra; HSI matching; SIFT; HSI classification; Spatial-spectral feature; Hyperspectral image
• ISSN: 0167-8655; 1872-7344
• DOI: 10.1016/j.patrec.2018.08.032

•We propose a new processing and analysis model called unified model of spectral value and gradient change(UMSGC) for HSIs.•We develop a new scale space generation method for HSI on UMSGC.•We put forward a new SIFT detector and descriptor for HSI matching and classification. The scale-invariant feature transform (SIFT) is known as one of the most robust local invariant feature and is widely applied to image matching and classification. However, There is few studies on SIFT for hyperspectral image (HSI). Hyperspectral image (HSI) embraces the spectral information reflecting the material radiation property and the geometrical relationship of the objects. Thus, HSI provides much more information than gray and color image. Therefore, this paper puts forward a spatial-spectral SIFT for HSI matching and classification by using the geometric algebra as its mathematic tool. It extracts and describes the spatial-spectral SIFT feature in the spatial-spectral domain to exploit both the spectral and spatial information of HSI. Firstly, a spatial-spectral unified model of spectral value and gradient change (UMSGC for short) is built to analyze spectral and spatial information for HSI synthetically. Secondly, the scale space for HSI based on UMSGC is designed. Finally, both the new detector and descriptor of the spatial-spectral SIFT for HSI that comprehensively consider spectral and spatial information are proposed. The experimental results show that the proposed algorithm demonstrates excellent performance in HSI matching and classification.