Semantics Outperforms Prosody in Emotional Speech Processing: Evidence from a Complex Stroop Experiment

Jing Qi; Kaile Zhang; Gang Peng

Semantics Outperforms Prosody in Emotional Speech Processing: Evidence from a Complex Stroop Experiment

Department of Language Science and Technology

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

Abstract

Semantic and prosodic cues both play crucial roles in conveying feelings and
emotions in speech communication. Previous studies on the salience effects in
emotional speech processing have shown inconsistent results. Most past research has focused on two simple categories of emotion. In this study, we investigated the perceptual saliency of the two cues in Mandarin using semantics-prosody Stroop tasks involving seven basic emotions: happiness, sadness, anger, fear, disgust, surprise, and neutrality. The results, based on 36 normal Chinese adults, demonstrated a semantic salience effect. This suggests that individuals may rely more on semantic cues when integrating emotional speech across different channels in more complex and challenging situations.

Original language	English
Title of host publication	Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation
Editors	Nathaniel Oco, Shirley N. Dita, Ariane Macalinga Borlongan, Jong-Bok Kim
Publisher	Tokyo University of Foreign Studies
Pages	1224-1232
Publication status	Published - Dec 2024
Event	The 38th Pacific Asia Conference on Language, Information and Computation [PACLIC-38] - Tokyo University of Foreign Studies, Tokyo, Japan Duration: 7 Dec 2024 → 9 Dec 2024

Conference

Conference	The 38th Pacific Asia Conference on Language, Information and Computation [PACLIC-38]
Country/Territory	Japan
City	Tokyo
Period	7/12/24 → 9/12/24

More information

https://aclanthology.org/2024.paclic-1.118.pdf

Cite this

Qi, J., Zhang, K., & Peng, G. (2024). Semantics Outperforms Prosody in Emotional Speech Processing: Evidence from a Complex Stroop Experiment. In N. Oco, S. N. Dita, A. M. Borlongan, & J.-B. Kim (Eds.), Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation (pp. 1224-1232). Tokyo University of Foreign Studies. https://aclanthology.org/2024.paclic-1.118.pdf

Qi, Jing ; Zhang, Kaile ; Peng, Gang. / Semantics Outperforms Prosody in Emotional Speech Processing : Evidence from a Complex Stroop Experiment. Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation. editor / Nathaniel Oco ; Shirley N. Dita ; Ariane Macalinga Borlongan ; Jong-Bok Kim. Tokyo University of Foreign Studies, 2024. pp. 1224-1232

@inproceedings{82ac7328ba554955ada161b97abbdc3f,

title = "Semantics Outperforms Prosody in Emotional Speech Processing: Evidence from a Complex Stroop Experiment",

abstract = "Semantic and prosodic cues both play crucial roles in conveying feelings and emotions in speech communication. Previous studies on the salience effects in emotional speech processing have shown inconsistent results. Most past research has focused on two simple categories of emotion. In this study, we investigated the perceptual saliency of the two cues in Mandarin using semantics-prosody Stroop tasks involving seven basic emotions: happiness, sadness, anger, fear, disgust, surprise, and neutrality. The results, based on 36 normal Chinese adults, demonstrated a semantic salience effect. This suggests that individuals may rely more on semantic cues when integrating emotional speech across different channels in more complex and challenging situations.",

author = "Jing Qi and Kaile Zhang and Gang Peng",

year = "2024",

month = dec,

language = "English",

pages = "1224--1232",

editor = "Nathaniel Oco and Dita, \{Shirley N.\} and Borlongan, \{Ariane Macalinga\} and Jong-Bok Kim",

booktitle = "Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation",

publisher = "Tokyo University of Foreign Studies",

note = "The 38th Pacific Asia Conference on Language, Information and Computation [PACLIC-38] ; Conference date: 07-12-2024 Through 09-12-2024",

}

Qi, J, Zhang, K & Peng, G 2024, Semantics Outperforms Prosody in Emotional Speech Processing: Evidence from a Complex Stroop Experiment. in N Oco, SN Dita, AM Borlongan & J-B Kim (eds), Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation. Tokyo University of Foreign Studies, pp. 1224-1232, The 38th Pacific Asia Conference on Language, Information and Computation [PACLIC-38], Tokyo, Japan, 7/12/24. <https://aclanthology.org/2024.paclic-1.118.pdf>

Semantics Outperforms Prosody in Emotional Speech Processing: Evidence from a Complex Stroop Experiment. / Qi, Jing; Zhang, Kaile ; Peng, Gang.
Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation. ed. / Nathaniel Oco; Shirley N. Dita; Ariane Macalinga Borlongan; Jong-Bok Kim. Tokyo University of Foreign Studies, 2024. p. 1224-1232.

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

TY - GEN

T1 - Semantics Outperforms Prosody in Emotional Speech Processing

T2 - The 38th Pacific Asia Conference on Language, Information and Computation [PACLIC-38]

AU - Qi, Jing

AU - Zhang, Kaile

AU - Peng, Gang

PY - 2024/12

Y1 - 2024/12

N2 - Semantic and prosodic cues both play crucial roles in conveying feelings and emotions in speech communication. Previous studies on the salience effects in emotional speech processing have shown inconsistent results. Most past research has focused on two simple categories of emotion. In this study, we investigated the perceptual saliency of the two cues in Mandarin using semantics-prosody Stroop tasks involving seven basic emotions: happiness, sadness, anger, fear, disgust, surprise, and neutrality. The results, based on 36 normal Chinese adults, demonstrated a semantic salience effect. This suggests that individuals may rely more on semantic cues when integrating emotional speech across different channels in more complex and challenging situations.

AB - Semantic and prosodic cues both play crucial roles in conveying feelings and emotions in speech communication. Previous studies on the salience effects in emotional speech processing have shown inconsistent results. Most past research has focused on two simple categories of emotion. In this study, we investigated the perceptual saliency of the two cues in Mandarin using semantics-prosody Stroop tasks involving seven basic emotions: happiness, sadness, anger, fear, disgust, surprise, and neutrality. The results, based on 36 normal Chinese adults, demonstrated a semantic salience effect. This suggests that individuals may rely more on semantic cues when integrating emotional speech across different channels in more complex and challenging situations.

M3 - Conference article published in proceeding or book

SP - 1224

EP - 1232

BT - Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation

A2 - Oco, Nathaniel

A2 - Dita, Shirley N.

A2 - Borlongan, Ariane Macalinga

A2 - Kim, Jong-Bok

PB - Tokyo University of Foreign Studies

Y2 - 7 December 2024 through 9 December 2024

ER -

Semantics Outperforms Prosody in Emotional Speech Processing: Evidence from a Complex Stroop Experiment

Abstract

Conference

More information

Fingerprint

Cite this