Adaptive Nonlocal Sparse Representation for Dual-Camera Compressive Hyperspectral Imaging

• Published in: IEEE transactions on pattern analysis and machine intelligence Vol. 39; no. 10; pp. 2104 - 2111
• Main Authors: Wang, Lizhi, Xiong, Zhiwei, Shi, Guangming, Wu, Feng, Zeng, Wenjun
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.10.2017; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Apertures; Cameras; Compressive sensing; Computer simulation; Dictionaries; Domains; dual-camera; Hyperspectral imaging; Image coding; Image enhancement; Image reconstruction; nonlocal similarity; Representations; Satellites; Similarity; sparse representation; Spectral analysis; State of the art; Three-dimensional displays; Two dimensional displays
• ISSN: 0162-8828; 2160-9292; 1939-3539
• DOI: 10.1109/TPAMI.2016.2621050

Leveraging the compressive sensing (CS) theory, coded aperture snapshot spectral imaging (CASSI) provides an efficient solution to recover 3D hyperspectral data from a 2D measurement. The dual-camera design of CASSI, by adding an uncoded panchromatic measurement, enhances the reconstruction fidelity while maintaining the snapshot advantage. In this paper, we propose an adaptive nonlocal sparse representation (ANSR) model to boost the performance of dual-camera compressive hyperspectral imaging (DCCHI). Specifically, the CS reconstruction problem is formulated as a 3D cube based sparse representation to make full use of the nonlocal similarity in both the spatial and spectral domains. Our key observation is that, the panchromatic image, besides playing the role of direct measurement, can be further exploited to help the nonlocal similarity estimation. Therefore, we design a joint similarity metric by adaptively combining the internal similarity within the reconstructed hyperspectral image and the external similarity within the panchromatic image. In this way, the fidelity of CS reconstruction is greatly enhanced. Both simulation and hardware experimental results show significant improvement of the proposed method over the state-of-the-art.