Investigating Acoustic Cues of Emotional Valence in Mandarin Speech Prosody - A Corpus Approach

Junlin Li; Chu Ren Huang

doi:10.1007/978-981-97-0586-3_25

Investigating Acoustic Cues of Emotional Valence in Mandarin Speech Prosody - A Corpus Approach

Junlin Li (Corresponding Author), Chu Ren Huang

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

Abstract

The impact of emotion on prosody in the context of speech communication has yielded inconclusive results when it comes to the prosodic patterns associated with high-arousal emotions of different emotional valences, such as “Happy” and “Anger”. To clarify the existing ambiguity, this study utilized an emotional speech database to examine prosodic metrics of multi-word verbal speech. The findings suggest that tempo is more of a reliable measure than pitch in conveying emotional valance. The syllables towards the end of a sentence are the most crucial in conveying valence or size projection, while non-final syllables provide a limited indication of valence or size projection.

Original language	English
Title of host publication	Chinese Lexical Semantics
Subtitle of host publication	24th Workshop, CLSW 2023, Singapore, Singapore, May 19–21, 2023, Revised Selected Papers, Part II
Editors	Minghui Dong, Jia-Fei Hong, Jingxia Lin, Peng Jin
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	316-330
Number of pages	15
ISBN (Electronic)	9789819705863
ISBN (Print)	9789819705856
DOIs	https://doi.org/10.1007/978-981-97-0586-3_25
Publication status	Published - 28 Feb 2024
Event	24th Workshop on Chinese Lexical Semantics, CLSW 2023 - Singapore, Singapore Duration: 19 May 2023 → 21 May 2023

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	14515 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	24th Workshop on Chinese Lexical Semantics, CLSW 2023
Country/Territory	Singapore
City	Singapore
Period	19/05/23 → 21/05/23

Keywords

Emotion
Emotional Valence
Prosody
Size-projection

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

More information

10.1007/978-981-97-0586-3_25

Cite this

Li, J., & Huang, C. R. (2024). Investigating Acoustic Cues of Emotional Valence in Mandarin Speech Prosody - A Corpus Approach. In M. Dong, J.-F. Hong, J. Lin, & P. Jin (Eds.), Chinese Lexical Semantics: 24th Workshop, CLSW 2023, Singapore, Singapore, May 19–21, 2023, Revised Selected Papers, Part II (pp. 316-330). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14515 LNAI). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-981-97-0586-3_25

Li, Junlin ; Huang, Chu Ren. / Investigating Acoustic Cues of Emotional Valence in Mandarin Speech Prosody - A Corpus Approach. Chinese Lexical Semantics: 24th Workshop, CLSW 2023, Singapore, Singapore, May 19–21, 2023, Revised Selected Papers, Part II. editor / Minghui Dong ; Jia-Fei Hong ; Jingxia Lin ; Peng Jin. Springer Science and Business Media Deutschland GmbH, 2024. pp. 316-330 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{b6d0da5071e34f0380fa81b67c047df8,

title = "Investigating Acoustic Cues of Emotional Valence in Mandarin Speech Prosody - A Corpus Approach",

abstract = "The impact of emotion on prosody in the context of speech communication has yielded inconclusive results when it comes to the prosodic patterns associated with high-arousal emotions of different emotional valences, such as “Happy” and “Anger”. To clarify the existing ambiguity, this study utilized an emotional speech database to examine prosodic metrics of multi-word verbal speech. The findings suggest that tempo is more of a reliable measure than pitch in conveying emotional valance. The syllables towards the end of a sentence are the most crucial in conveying valence or size projection, while non-final syllables provide a limited indication of valence or size projection.",

keywords = "Emotion, Emotional Valence, Prosody, Size-projection",

author = "Junlin Li and Huang, {Chu Ren}",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.; 24th Workshop on Chinese Lexical Semantics, CLSW 2023 ; Conference date: 19-05-2023 Through 21-05-2023",

year = "2024",

month = feb,

day = "28",

doi = "10.1007/978-981-97-0586-3_25",

language = "English",

isbn = "9789819705856",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "316--330",

editor = "Minghui Dong and Jia-Fei Hong and Jingxia Lin and Peng Jin",

booktitle = "Chinese Lexical Semantics",

address = "Germany",

}

Li, J & Huang, CR 2024, Investigating Acoustic Cues of Emotional Valence in Mandarin Speech Prosody - A Corpus Approach. in M Dong, J-F Hong, J Lin & P Jin (eds), Chinese Lexical Semantics: 24th Workshop, CLSW 2023, Singapore, Singapore, May 19–21, 2023, Revised Selected Papers, Part II. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 14515 LNAI, Springer Science and Business Media Deutschland GmbH, pp. 316-330, 24th Workshop on Chinese Lexical Semantics, CLSW 2023, Singapore, Singapore, 19/05/23. https://doi.org/10.1007/978-981-97-0586-3_25

Investigating Acoustic Cues of Emotional Valence in Mandarin Speech Prosody - A Corpus Approach. / Li, Junlin (Corresponding Author); Huang, Chu Ren.
Chinese Lexical Semantics: 24th Workshop, CLSW 2023, Singapore, Singapore, May 19–21, 2023, Revised Selected Papers, Part II. ed. / Minghui Dong; Jia-Fei Hong; Jingxia Lin; Peng Jin. Springer Science and Business Media Deutschland GmbH, 2024. p. 316-330 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14515 LNAI).

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

TY - GEN

T1 - Investigating Acoustic Cues of Emotional Valence in Mandarin Speech Prosody - A Corpus Approach

AU - Li, Junlin

AU - Huang, Chu Ren

N1 - Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.

PY - 2024/2/28

Y1 - 2024/2/28

N2 - The impact of emotion on prosody in the context of speech communication has yielded inconclusive results when it comes to the prosodic patterns associated with high-arousal emotions of different emotional valences, such as “Happy” and “Anger”. To clarify the existing ambiguity, this study utilized an emotional speech database to examine prosodic metrics of multi-word verbal speech. The findings suggest that tempo is more of a reliable measure than pitch in conveying emotional valance. The syllables towards the end of a sentence are the most crucial in conveying valence or size projection, while non-final syllables provide a limited indication of valence or size projection.

AB - The impact of emotion on prosody in the context of speech communication has yielded inconclusive results when it comes to the prosodic patterns associated with high-arousal emotions of different emotional valences, such as “Happy” and “Anger”. To clarify the existing ambiguity, this study utilized an emotional speech database to examine prosodic metrics of multi-word verbal speech. The findings suggest that tempo is more of a reliable measure than pitch in conveying emotional valance. The syllables towards the end of a sentence are the most crucial in conveying valence or size projection, while non-final syllables provide a limited indication of valence or size projection.

KW - Emotion

KW - Emotional Valence

KW - Prosody

KW - Size-projection

UR - http://www.scopus.com/inward/record.url?scp=85187641391&partnerID=8YFLogxK

U2 - 10.1007/978-981-97-0586-3_25

DO - 10.1007/978-981-97-0586-3_25

M3 - Conference article published in proceeding or book

AN - SCOPUS:85187641391

SN - 9789819705856

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 316

EP - 330

BT - Chinese Lexical Semantics

A2 - Dong, Minghui

A2 - Hong, Jia-Fei

A2 - Lin, Jingxia

A2 - Jin, Peng

PB - Springer Science and Business Media Deutschland GmbH

T2 - 24th Workshop on Chinese Lexical Semantics, CLSW 2023

Y2 - 19 May 2023 through 21 May 2023

ER -

Li J, Huang CR. Investigating Acoustic Cues of Emotional Valence in Mandarin Speech Prosody - A Corpus Approach. In Dong M, Hong JF, Lin J, Jin P, editors, Chinese Lexical Semantics: 24th Workshop, CLSW 2023, Singapore, Singapore, May 19–21, 2023, Revised Selected Papers, Part II. Springer Science and Business Media Deutschland GmbH. 2024. p. 316-330. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-981-97-0586-3_25