# Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Zhi Wei Pan, Hui Liang Shen, Chunguang Li, Shu Jie Chen, John Haozhong Xin

Research output: Journal article publicationJournal articleAcademic researchpeer-review

7 Citations (Scopus)

## Abstract

Multispectral imaging system is of wide application in relevant fields for its capability in acquiring spectral information of scenes. Its limitation is that, due to the large number of spectral channels, the imaging process can be quite time-consuming when capturing high-resolution (HR) multispectral images. To resolve this limitation, this paper proposes a fast multispectral imaging framework based on the image sensor pixel-binning and spectral unmixing techniques. The framework comprises a fast imaging stage and a computational reconstruction stage. In the imaging stage, only a few spectral images are acquired in HR, while most spectral images are acquired in low resolution (LR). The LR images are captured by applying pixel binning on the image sensor, such that the exposure time can be greatly reduced. In the reconstruction stage, an optimal number of basis spectra are computed and the signal-dependent noise statistics are estimated. Then the unknown HR images are efficiently reconstructed by solving a closed-form cost function that models the spatial and spectral degradations. The effectiveness of the proposed framework is evaluated using real-scene multispectral images. Experimental results validate that, in general, the method outperforms the state of the arts in terms of reconstruction accuracy, with additional $20\times$ or more improvement in computational efficiency.
Original language English 7484284 3612-3625 14 IEEE Transactions on Image Processing 25 8 https://doi.org/10.1109/TIP.2016.2576401 Published - 1 Aug 2016

## Keywords

• basis spectra
• high-resolution image
• image fusion
• image reconstruction
• imaging efficiency
• Multispectral imaging
• pixel-binning
• signal-dependent noise
• spectral unmixing

## ASJC Scopus subject areas

• Software
• Computer Graphics and Computer-Aided Design