Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Zhi Wei Pan, Hui Liang Shen, Chunguang Li, Shu Jie Chen, John Haozhong Xin

Research output: Journal article publicationJournal articleAcademic researchpeer-review

7 Citations (Scopus)


Multispectral imaging system is of wide application in relevant fields for its capability in acquiring spectral information of scenes. Its limitation is that, due to the large number of spectral channels, the imaging process can be quite time-consuming when capturing high-resolution (HR) multispectral images. To resolve this limitation, this paper proposes a fast multispectral imaging framework based on the image sensor pixel-binning and spectral unmixing techniques. The framework comprises a fast imaging stage and a computational reconstruction stage. In the imaging stage, only a few spectral images are acquired in HR, while most spectral images are acquired in low resolution (LR). The LR images are captured by applying pixel binning on the image sensor, such that the exposure time can be greatly reduced. In the reconstruction stage, an optimal number of basis spectra are computed and the signal-dependent noise statistics are estimated. Then the unknown HR images are efficiently reconstructed by solving a closed-form cost function that models the spatial and spectral degradations. The effectiveness of the proposed framework is evaluated using real-scene multispectral images. Experimental results validate that, in general, the method outperforms the state of the arts in terms of reconstruction accuracy, with additional $20\times $ or more improvement in computational efficiency.
Original languageEnglish
Article number7484284
Pages (from-to)3612-3625
Number of pages14
JournalIEEE Transactions on Image Processing
Issue number8
Publication statusPublished - 1 Aug 2016


  • basis spectra
  • high-resolution image
  • image fusion
  • image reconstruction
  • imaging efficiency
  • Multispectral imaging
  • pixel-binning
  • signal-dependent noise
  • spectral unmixing

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this