Sparse representation based image interpolation with nonlocal autoregressive modeling

Weisheng Dong, Lei Zhang, Rastislav Lukac, Guangming Shi

Research output: Journal article publicationJournal articleAcademic researchpeer-review

298 Citations (Scopus)

Abstract

Sparse representation is proven to be a promising approach to image super-resolution, where the low-resolution (LR) image is usually modeled as the down-sampled version of its high-resolution (HR) counterpart after blurring. When the blurring kernel is the Dirac delta function, i.e., the LR image is directly down-sampled from its HR counterpart without blurring, the super-resolution problem becomes an image interpolation problem. In such cases, however, the conventional sparse representation models (SRM) become less effective, because the data fidelity term fails to constrain the image local structures. In natural images, fortunately, many nonlocal similar patches to a given patch could provide nonlocal constraint to the local structure. In this paper, we incorporate the image nonlocal self-similarity into SRM for image interpolation. More specifically, a nonlocal autoregressive model (NARM) is proposed and taken as the data fidelity term in SRM. We show that the NARM-induced sampling matrix is less coherent with the representation dictionary, and consequently makes SRM more effective for image interpolation. Our extensive experimental results demonstrate that the proposed NARM-based image interpolation method can effectively reconstruct the edge structures and suppress the jaggy/ringing artifacts, achieving the best image interpolation results so far in terms of PSNR as well as perceptual quality metrics such as SSIM and FSIM.
Original languageEnglish
Article number6408143
Pages (from-to)1382-1394
Number of pages13
JournalIEEE Transactions on Image Processing
Volume22
Issue number4
DOIs
Publication statusPublished - 18 Feb 2013

Keywords

  • Image interpolation
  • nonlocal autoregressive model
  • sparse representation
  • super-resolution

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this