Recognizing human faces under disguise and makeup

Tsung Ying Wang, Ajay Kumar Pathak

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

35 Citations (Scopus)


The accuracy of automated human face recognition algorithms can significantly degrade while recognizing same subjects under make-up and disguised appearances. Increasing constraints on enhanced security and surveillance requires enhanced accuracy from face recognition algorithms for faces under disguise and/or makeup. This paper presents a new database for face images under disguised and make-up appearances the development of face recognition algorithms under such covariates. This database has 2460 images from 410 different subjects and is acquired under real environment, focuses on make-up and disguises covariates and also provides ground truth (eye glass, goggle, mustache, beard) for every image. This can enable developed algorithms to automatically quantify their capability for identifying such important disguise attribute during the face recognition We also present comparative experimental results from two popular commercial matchers and from recent publications. Our experimental results suggest significant performance degradation in the capability of these matchers in automatically recognizing these faces. We also analyze face detection accuracy from these matchers. The experimental results underline the challenges in recognizing faces under these covariates. Availability of this new database in public domain will help to advance much needed research and development in recognizing make-up and disguised faces.
Original languageEnglish
Title of host publicationISBA 2016 - IEEE International Conference on Identity, Security and Behavior Analysis
ISBN (Electronic)9781467397278
Publication statusPublished - 23 May 2016
Event2nd IEEE International Conference on Identity, Security and Behavior Analysis, ISBA 2016 - Sakura Hall, Tohoku University, Sendai, Japan
Duration: 29 Feb 20162 Mar 2016


Conference2nd IEEE International Conference on Identity, Security and Behavior Analysis, ISBA 2016

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Human Factors and Ergonomics


Dive into the research topics of 'Recognizing human faces under disguise and makeup'. Together they form a unique fingerprint.

Cite this