From local pixel structure to global image super-resolution: A new face hallucination framework

Yu Hu, Kin Man Lam, Guoping Qiu, Tingzhi Shen

Research output: Journal article publicationJournal articleAcademic researchpeer-review

72 Citations (Scopus)

Abstract

We have developed a new face hallucination framework termed from local pixel structure to global image super-resolution (LPS-GIS). Based on the assumption that two similar face images should have similar local pixel structures, the new framework first uses the input low-resolution (LR) face image to search a face database for similar example high-resolution (HR) faces in order to learn the local pixel structures for the target HR face. It then uses the input LR face and the learned pixel structures as priors to estimate the target HR face. We present a three-step implementation procedure for the framework. Step 1 searches the database for K example faces that are the most similar to the input, and then warps the K example images to the input using optical flow. Step 2 uses the warped HR version of the K example faces to learn the local pixel structures for the target HR face. An effective method for learning local pixel structures from an individual face, and an adaptive procedure for fusing the local pixel structures of different example faces to reduce the influence of warping errors, have been developed. Step 3 estimates the target HR face by solving a constrained optimization problem by means of an iterative procedure. Experimental results show that our new method can provide good performances for face hallucination, both in terms of reconstruction error and visual quality; and that it is competitive with existing state-of-the-art methods.
Original languageEnglish
Article number5540293
Pages (from-to)433-445
Number of pages13
JournalIEEE Transactions on Image Processing
Volume20
Issue number2
DOIs
Publication statusPublished - 1 Feb 2011

Keywords

  • Face hallucination
  • face super-resolution (SR)
  • neighbor embedding
  • pixel-structure learning

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this