Multi-resolution feature fusion for face recognition

Kuong Hon Pong, Kin Man Lam

Research output: Journal article publicationJournal articleAcademic researchpeer-review

55 Citations (Scopus)

Abstract

For face recognition, image features are first extracted and then matched to those features in a gallery set. The amount of information and the effectiveness of the features used will determine the recognition performance. In this paper, we propose a novel face recognition approach using information about face images at higher and lower resolutions so as to enhance the information content of the features that are extracted and combined at different resolutions. As the features from different resolutions should closely correlate with each other, we employ the cascaded generalized canonical correlation analysis (GCCA) to fuse the information to form a single feature vector for face recognition. To improve the performance and efficiency, we also employ "Gabor-feature hallucination", which predicts the high-resolution (HR) Gabor features from the Gabor features of a face image directly by local linear regression. We also extend the algorithm to low-resolution (LR) face recognition, in which the medium-resolution (MR) and HR Gabor features of a LR input image are estimated directly. The LR Gabor features and the predicted MR and HR Gabor features are then fused using GCCA for LR face recognition. Our algorithm can avoid having to perform the interpolation/super-resolution of face images and having to extract HR Gabor features. Experimental results show that the proposed methods have a superior recognition rate and are more efficient than traditional methods.
Original languageEnglish
Pages (from-to)556-567
Number of pages12
JournalPattern Recognition
Volume47
Issue number2
DOIs
Publication statusPublished - 1 Feb 2014

Keywords

  • Cascaded generalized canonical correlation analysis
  • Gabor feature hallucination
  • Low-resolution face recognition
  • Multi-resolution face recognition

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Cite this