Improvement of color video demosaicking in temporal domain

Xiaolin Wu, Lei Zhang

Research output: Journal article publicationJournal articleAcademic researchpeer-review

19 Citations (Scopus)

Abstract

Color demosaicking is critical to the image quality of digital still and video cameras that use a single-sensor array. Limited by the mosaic sampling pattern of the color filter array (CFA), color artifacts may occur in a demosaicked image in areas of high-frequency and/or sharp color transition structures. However, a color digital video camera captures a sequence of mosaic images and the temporal dimension of the color signals provides a rich source of information about the scene via camera and object motions. This paper proposes an inter-frame demosaicking approach to take advantage of all three forms of pixel correlations: spatial, spectral, and temporal. By motion estimation and statistical data fusion between adjacent mosaic frames, the new approach can remove much of the color artifacts that survive intra-frame demosaicking and also improve tone reproduction accuracy. Empirical results show that the proposed inter-frame demosaicking approach consistently outperforms its intra-frame counterparts both in peak signal-to-noise measure and subjective visual quality.
Original languageEnglish
Pages (from-to)3138-3151
Number of pages14
JournalIEEE Transactions on Image Processing
Volume15
Issue number10
DOIs
Publication statusPublished - 1 Oct 2006

Keywords

  • Bayer color filter array
  • Data fusion
  • Digital video
  • Subpixel motion estimation
  • Temporal color demosaicking

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this