Intelligible enhancement of 3D articulation animation by incorporating airflow information

Fei Chen; Hui Chen; Lan Wang; Ying Zhou; Jiaying He; Nan Yan; Gang Peng

doi:10.1109/ICASSP.2016.7472855

Intelligible enhancement of 3D articulation animation by incorporating airflow information

Fei Chen, Hui Chen, Lan Wang, Ying Zhou, Jiaying He, Nan Yan, Gang Peng

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

5 Citations (Scopus)

Abstract

The 3D talking head has been developed fast, in which both external and internal articulators were demonstrated. For Mandarin pronunciation, the aspiration airflow is crucial to discriminate confusable Mandarin consonants. In this paper, we present a 3D talking head system for articulatory and aspiration animation with the use of EMA articulation data and airflow data simultaneously. The quantitative analyses of airflow data indicated confusable Mandarin consonants could be distinguished from each other by the mean airflow during voicing, peak expiratory airflow, and airflow duration. An airflow model was then incorporated into the 3D articulatory model to produce the airflow in accordance with articulator movements of Mandarin pronunciation. An audio-visual test was designed to evaluate the current 3D articulation and aspiration system, where minimal pairs were used to recognize the animation. The identification accuracy was significantly improved from 43.9% without airflow to 84.8% with airflow-incorporated information.

Original language	English
Title of host publication	2016 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2016 - Proceedings
Publisher	IEEE
Pages	6130-6134
Number of pages	5
Volume	2016-May
ISBN (Electronic)	9781479999880
DOIs	https://doi.org/10.1109/ICASSP.2016.7472855
Publication status	Published - 18 May 2016
Externally published	Yes
Event	41st IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2016 - Shanghai International Convention Center, Shanghai, China Duration: 20 Mar 2016 → 25 Mar 2016

Conference

Conference	41st IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2016
Country/Territory	China
City	Shanghai
Period	20/03/16 → 25/03/16

Keywords

3D articulatory dynamics
Airflow
confusable consonants
intelligible enhancement
PAS

ASJC Scopus subject areas

Software
Signal Processing
Electrical and Electronic Engineering

More information

10.1109/ICASSP.2016.7472855

Cite this

Chen, F., Chen, H., Wang, L., Zhou, Y., He, J., Yan, N., & Peng, G. (2016). Intelligible enhancement of 3D articulation animation by incorporating airflow information. In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2016 - Proceedings (Vol. 2016-May, pp. 6130-6134). Article 7472855 IEEE. https://doi.org/10.1109/ICASSP.2016.7472855

@inproceedings{d73754b51b3446c191ef0ac85e557382,

title = "Intelligible enhancement of 3D articulation animation by incorporating airflow information",

abstract = "The 3D talking head has been developed fast, in which both external and internal articulators were demonstrated. For Mandarin pronunciation, the aspiration airflow is crucial to discriminate confusable Mandarin consonants. In this paper, we present a 3D talking head system for articulatory and aspiration animation with the use of EMA articulation data and airflow data simultaneously. The quantitative analyses of airflow data indicated confusable Mandarin consonants could be distinguished from each other by the mean airflow during voicing, peak expiratory airflow, and airflow duration. An airflow model was then incorporated into the 3D articulatory model to produce the airflow in accordance with articulator movements of Mandarin pronunciation. An audio-visual test was designed to evaluate the current 3D articulation and aspiration system, where minimal pairs were used to recognize the animation. The identification accuracy was significantly improved from 43.9\% without airflow to 84.8\% with airflow-incorporated information.",

keywords = "3D articulatory dynamics, Airflow, confusable consonants, intelligible enhancement, PAS",

author = "Fei Chen and Hui Chen and Lan Wang and Ying Zhou and Jiaying He and Nan Yan and Gang Peng",

year = "2016",

month = may,

day = "18",

doi = "10.1109/ICASSP.2016.7472855",

language = "English",

volume = "2016-May",

pages = "6130--6134",

booktitle = "2016 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2016 - Proceedings",

publisher = "IEEE",

address = "United States",

note = "41st IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2016 ; Conference date: 20-03-2016 Through 25-03-2016",

}

Chen, F, Chen, H, Wang, L, Zhou, Y, He, J, Yan, N & Peng, G 2016, Intelligible enhancement of 3D articulation animation by incorporating airflow information. in 2016 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2016 - Proceedings. vol. 2016-May, 7472855, IEEE, pp. 6130-6134, 41st IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2016, Shanghai, China, 20/03/16. https://doi.org/10.1109/ICASSP.2016.7472855

Intelligible enhancement of 3D articulation animation by incorporating airflow information. / Chen, Fei; Chen, Hui; Wang, Lan et al.
2016 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2016 - Proceedings. Vol. 2016-May IEEE, 2016. p. 6130-6134 7472855.

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

TY - GEN

T1 - Intelligible enhancement of 3D articulation animation by incorporating airflow information

AU - Chen, Fei

AU - Chen, Hui

AU - Wang, Lan

AU - Zhou, Ying

AU - He, Jiaying

AU - Yan, Nan

AU - Peng, Gang

PY - 2016/5/18

Y1 - 2016/5/18

N2 - The 3D talking head has been developed fast, in which both external and internal articulators were demonstrated. For Mandarin pronunciation, the aspiration airflow is crucial to discriminate confusable Mandarin consonants. In this paper, we present a 3D talking head system for articulatory and aspiration animation with the use of EMA articulation data and airflow data simultaneously. The quantitative analyses of airflow data indicated confusable Mandarin consonants could be distinguished from each other by the mean airflow during voicing, peak expiratory airflow, and airflow duration. An airflow model was then incorporated into the 3D articulatory model to produce the airflow in accordance with articulator movements of Mandarin pronunciation. An audio-visual test was designed to evaluate the current 3D articulation and aspiration system, where minimal pairs were used to recognize the animation. The identification accuracy was significantly improved from 43.9% without airflow to 84.8% with airflow-incorporated information.

AB - The 3D talking head has been developed fast, in which both external and internal articulators were demonstrated. For Mandarin pronunciation, the aspiration airflow is crucial to discriminate confusable Mandarin consonants. In this paper, we present a 3D talking head system for articulatory and aspiration animation with the use of EMA articulation data and airflow data simultaneously. The quantitative analyses of airflow data indicated confusable Mandarin consonants could be distinguished from each other by the mean airflow during voicing, peak expiratory airflow, and airflow duration. An airflow model was then incorporated into the 3D articulatory model to produce the airflow in accordance with articulator movements of Mandarin pronunciation. An audio-visual test was designed to evaluate the current 3D articulation and aspiration system, where minimal pairs were used to recognize the animation. The identification accuracy was significantly improved from 43.9% without airflow to 84.8% with airflow-incorporated information.

KW - 3D articulatory dynamics

KW - Airflow

KW - confusable consonants

KW - intelligible enhancement

KW - PAS

UR - http://www.scopus.com/inward/record.url?scp=84973299464&partnerID=8YFLogxK

U2 - 10.1109/ICASSP.2016.7472855

DO - 10.1109/ICASSP.2016.7472855

M3 - Conference article published in proceeding or book

VL - 2016-May

SP - 6130

EP - 6134

BT - 2016 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2016 - Proceedings

PB - IEEE

T2 - 41st IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2016

Y2 - 20 March 2016 through 25 March 2016

ER -

Intelligible enhancement of 3D articulation animation by incorporating airflow information

Abstract

Conference

Keywords

ASJC Scopus subject areas

More information

Other files and links

Fingerprint

Cite this