Does musical experience facilitate phonetic accommodation during human-robot interaction?

Yitian Hong, Si Chen (Corresponding Author), Han Jiang

Research output: Journal article publicationJournal articleAcademic researchpeer-review

Abstract

Purpose: This study investigated the effect of musical training on phonetic accommodation in a second language (L2) after interacting with a social robot, exploring the motivations and reasons behind their accommodation strategies.

Method: Fifteen L2 English speakers with long-term musical training experience (musician group) and 15 speakers without musical training experience (nonmusician group) were recruited to complete four conversational tasks with the social robot Furhat. Their production of a list of key words and carrier sentences was collected before and after conversations and used to quantify their phonetic accommodations. The spectral cues and prosodic cues of the production were extracted and analyzed.

Results: Both groups showed similar convergence patterns but different divergence patterns. Specifically, the musician group showed divergence from the robot's production on more prosodic cues (mean fundamental frequency and duration) than the nonmusician group. Both groups converged their vowel formants toward the robot without group differences.

Conclusions: The findings reflect individuals' assessment of the robot's speech characteristics and their efforts to enhance communication efficiency, which might indicate a special speech register used for addressing the robot. The finding is more noticeable in the musician group compared to the nonmusician group. We proposed two possible explanations of the effect of musical training on phonetic accommodations: one involves the training of auditory attention and working memory and the other relates to the refinement of phonetic talent in L2 acquisition, contributing to theories on the relationship between music and language. This study also has implications for applying musical training to speech communication training in clinical populations and for designing social robots to better serve as speech therapy partners.
Original languageEnglish
Pages (from-to)2259-2274
Number of pages16
JournalJournal of Speech and Hearing Disorders
Volume68
Issue number5
DOIs
Publication statusPublished - 8 May 2025

Fingerprint

Dive into the research topics of 'Does musical experience facilitate phonetic accommodation during human-robot interaction?'. Together they form a unique fingerprint.

Cite this