Smile detection in the wild with deep convolutional neural networks

Junkai Chen, Qihao Ou, Zheru Chi, Hong Fu

Research output: Journal article publicationJournal articleAcademic researchpeer-review

45 Citations (Scopus)


Smile or happiness is one of the most universal facial expressions in our daily life. Smile detection in the wild is an important and challenging problem, which has attracted a growing attention from affective computing community. In this paper, we present an efficient approach for smile detection in the wild with deep learning. Different from some previous work which extracted hand-crafted features from face images and trained a classifier to perform smile recognition in a two-step approach, deep learning can effectively combine feature learning and classification into a single model. In this study, we apply the deep convolutional network, a popular deep learning model, to handle this problem. We construct a deep convolutional network called Smile-CNN to perform feature learning and smile detection simultaneously. Experimental results demonstrate that although a deep learning model is generally developed for tackling “big data,” the model can also effectively deal with “small data.” We further investigate into the discriminative power of the learned features, which are taken from the neuron activations of the last hidden layer of our Smile-CNN. By using the learned features to train an SVM or AdaBoost classifier, we show that the learned features have impressive discriminative ability. Experiments conducted on the GENKI4K database demonstrate that our approach can achieve a promising performance in smile detection.
Original languageEnglish
Pages (from-to)173-183
Number of pages11
JournalMachine Vision and Applications
Issue number1-2
Publication statusPublished - 1 Feb 2017


  • Convolution neural network
  • Deep learning
  • Feature learning
  • In the wild
  • Smile detection

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Vision and Pattern Recognition
  • Computer Science Applications


Dive into the research topics of 'Smile detection in the wild with deep convolutional neural networks'. Together they form a unique fingerprint.

Cite this