A nonlinear least square technique for simultaneous image registration and super-resolution

Yu He, Kim Hui Yap, Li Chen, Lap Pui Chau

Research output: Journal article publicationJournal articleAcademic researchpeer-review

112 Citations (Scopus)


This paper proposes a new algorithm to integrate image registration into image super-resolution (SR). Image SR is a process to reconstruct a high-resolution (HR) image by fusing multiple low-resolution (LR) images. A critical step in image SR is accurate registration of the LR images or, in other words, effective estimation of motion parameters. Conventional SR algorithms assume either the estimated motion parameters by existing registration methods to be error-free or the motion parameters are known a priori. This assumption, however, is impractical in many applications, as most existing registration algorithms still experience various degrees of errors, and the motion parameters among the LR images are generally unknown a priori. In view of this, this paper presents a new framework that performs simultaneous image registration and HR image reconstruction. As opposed to other current methods that treat image registration and HR reconstruction as disjoint processes, the new framework enables image registration and HR reconstruction to be estimated simultaneously and improved progressively. Further, unlike most algorithms that focus on the translational motion model, the proposed method adopts a more generic motion model that includes both translation as well as rotation. An iterative scheme is developed to solve the arising nonlinear least squares problem. Experimental results show that the proposed method is effective in performing image registration and SR for simulated as well as real-life images.

Original languageEnglish
Pages (from-to)2830-2841
Number of pages12
JournalIEEE Transactions on Image Processing
Issue number11
Publication statusPublished - Nov 2007
Externally publishedYes


  • Image registration
  • Image super-resolution (SR)
  • Nonlinear least squares methods

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'A nonlinear least square technique for simultaneous image registration and super-resolution'. Together they form a unique fingerprint.

Cite this