TY - GEN
T1 - Facial Expressions of Sentence Comprehension
AU - Turan, Cigdem
AU - Wang, Yixin
AU - Lai, Shun Cheung
AU - Neergaard, Karl David
AU - Lam, Kin Man
PY - 2018/11/19
Y1 - 2018/11/19
N2 - Understanding facial expressions allows access to one's intentional and affective states. Using the findings in psychology and neuroscience, in which physical behaviors of the face are linked to emotional states, this paper aims to study sentence comprehension shown by facial expressions. In our experiments, participants took part in a roughly 30-minute computer mediated task, where they were asked to answer either 'true' or 'false' to knowledge-based questions, then immediately given feedback of 'correct' or 'incorrect'. Their faces, which were recorded during the task using the Kinect v2 device, are later used to identify the level of comprehension shown by their expressions. To achieve this, the SVM and Random Forest classifiers with facial appearance information extracted using a spatiotemporal local descriptor, named LPQ-TOP, are employed. Results of online sentence comprehension show that facial dynamics are promising to help understand cognitive states of the mind.
AB - Understanding facial expressions allows access to one's intentional and affective states. Using the findings in psychology and neuroscience, in which physical behaviors of the face are linked to emotional states, this paper aims to study sentence comprehension shown by facial expressions. In our experiments, participants took part in a roughly 30-minute computer mediated task, where they were asked to answer either 'true' or 'false' to knowledge-based questions, then immediately given feedback of 'correct' or 'incorrect'. Their faces, which were recorded during the task using the Kinect v2 device, are later used to identify the level of comprehension shown by their expressions. To achieve this, the SVM and Random Forest classifiers with facial appearance information extracted using a spatiotemporal local descriptor, named LPQ-TOP, are employed. Results of online sentence comprehension show that facial dynamics are promising to help understand cognitive states of the mind.
KW - affective computing
KW - facial expression recognition
KW - human-computer interaction
KW - sentence comprehension
UR - http://www.scopus.com/inward/record.url?scp=85062773494&partnerID=8YFLogxK
U2 - 10.1109/ICDSP.2018.8631633
DO - 10.1109/ICDSP.2018.8631633
M3 - Conference article published in proceeding or book
AN - SCOPUS:85062773494
T3 - International Conference on Digital Signal Processing, DSP
BT - 2018 IEEE 23rd International Conference on Digital Signal Processing, DSP 2018
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 23rd IEEE International Conference on Digital Signal Processing, DSP 2018
Y2 - 19 November 2018 through 21 November 2018
ER -