TY - JOUR
T1 - Implicit and Explicit Feature Purification for Age-Invariant Facial Representation Learning
AU - Xie, Jiu Cheng
AU - Pun, Chi Man
AU - Lam, Kin Man
N1 - This work was supported in part by the Research Grant from The Hong Kong Polytechnic University under Project SB2U; in part by the Science and Technology Development Fund, Macau SAR, under Grant 0034/2019/AMJ, Grant 0087/2020/A2, and Grant 0049/2021/A; and was performed in part at the Super Intelligent Computing Center (SICC) which is supported by the State Key Laboratory of Internet of Things for Smart City (SKL-IOTSC), University of Macau. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Walter Scheirer. (Corresponding author: Chi-Man Pun.)
Publisher Copyright:
© 2022 IEEE.
PY - 2022/1
Y1 - 2022/1
N2 - This paper presents a new method, named implicit and explicit feature purification (IEFP), for age-invariant face recognition. Facial features extracted from a face image contain the information about the identity, age, and other attributes. For age-invariant face recognition, it is important to remove the irrelevant information, and retain the identity information only, in the facial features. Through the two proposed feature purification mechanisms, our framework can produce facial-feature embeddings that preserve identity information as much as possible and are insensitive to age variations. Specifically, on the one hand, a special network module is devised to implicitly purify the original facial features obtained from a face encoder. On the other hand, to obtain purer facial feature representations for age-invariant face recognition, irrelevant information within the implicitly purified features, such as the age, is further removed. This is realized by using a regularizer, based on information theory, to explicitly minimize the correlation between identity-related features and age-related features. Comprehensive ablation studies show that these two feature purification schemes can work independently, as well as collaboratively, to achieve better performance. Extensive evaluations on several benchmark data sets show that the IEFP method is on par with those competitors learned on far more favorable training samples, and it achieves the best performance in a fair comparison. Furthermore, we provide mathematical interpretation to explain the effectiveness of our approach, and find that it tends to generate low-rank, yet high-dimensional, representations for age-invariant face recognition.
AB - This paper presents a new method, named implicit and explicit feature purification (IEFP), for age-invariant face recognition. Facial features extracted from a face image contain the information about the identity, age, and other attributes. For age-invariant face recognition, it is important to remove the irrelevant information, and retain the identity information only, in the facial features. Through the two proposed feature purification mechanisms, our framework can produce facial-feature embeddings that preserve identity information as much as possible and are insensitive to age variations. Specifically, on the one hand, a special network module is devised to implicitly purify the original facial features obtained from a face encoder. On the other hand, to obtain purer facial feature representations for age-invariant face recognition, irrelevant information within the implicitly purified features, such as the age, is further removed. This is realized by using a regularizer, based on information theory, to explicitly minimize the correlation between identity-related features and age-related features. Comprehensive ablation studies show that these two feature purification schemes can work independently, as well as collaboratively, to achieve better performance. Extensive evaluations on several benchmark data sets show that the IEFP method is on par with those competitors learned on far more favorable training samples, and it achieves the best performance in a fair comparison. Furthermore, we provide mathematical interpretation to explain the effectiveness of our approach, and find that it tends to generate low-rank, yet high-dimensional, representations for age-invariant face recognition.
KW - Data mining
KW - Face recognition
KW - Facial features
KW - Feature extraction
KW - Purification
KW - Task analysis
KW - Training
UR - http://www.scopus.com/inward/record.url?scp=85123345003&partnerID=8YFLogxK
U2 - 10.1109/TIFS.2022.3142998
DO - 10.1109/TIFS.2022.3142998
M3 - Journal article
AN - SCOPUS:85123345003
SN - 1556-6013
VL - 17
SP - 399
EP - 412
JO - IEEE Transactions on Information Forensics and Security
JF - IEEE Transactions on Information Forensics and Security
ER -