Facial expression recognition with emotion-based feature fusion

C. Turan, Kin Man Lam, X. He

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review


In this paper, we propose an emotion-based feature fusion method using the Discriminant-Analysis of Canonical Correlations (DCC) for facial expression recognition. There have been many image features or descriptors proposed for facial expression recognition. For the different features, they may be more accurate for the recognition of different expressions. In our proposed method, four effective descriptors for facial expression representation, namely Local Binary Pattern (LBP), Local Phase Quantization (LPQ), Weber Local Descriptor (WLD), and Pyramid of Histogram of Oriented Gradients (PHOG), are considered. Supervised Locality Preserving Projection (SLPP) is applied to the respective features for dimensionality reduction and manifold learning. Experiments show that descriptors are also sensitive to the conditions of images, such as race, lighting, pose, etc. Thus, an adaptive descriptor selection algorithm is proposed, which determines the best two features for each expression class on a given training set. These two features are fused, so as to achieve a higher recognition rate for each expression. In our experiments, the JAFFE and BAUM-2 databases are used, and experiment results show that the descriptor selection step increases the recognition rate up to 2%.
Original languageEnglish
Title of host publication2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2015
Number of pages5
ISBN (Electronic)9789881476807
ISBN (Print)9781467395939
Publication statusPublished - 2015
EventAsia-Pacific Signal and Information Processing Association (APSIPA). Summit and Conference -
Duration: 1 Jan 2015 → …


ConferenceAsia-Pacific Signal and Information Processing Association (APSIPA). Summit and Conference
Period1/01/15 → …


  • Feature extraction
  • Face recognition
  • Histograms
  • Databases
  • Correlation
  • Manifolds
  • Training


Dive into the research topics of 'Facial expression recognition with emotion-based feature fusion'. Together they form a unique fingerprint.

Cite this