Temporal Eye-Voice Span as a Dynamic Indicator for Cognitive Effort During Speech Processing: A Comparative Study of Reading Aloud and Sight Translation

Hao Zhou, Yu Weng, Binghan Zheng

Research output: Chapter in book / Conference proceedingChapter in an edited book (as author)Academic researchpeer-review

1 Citation (Scopus)

Abstract

This chapter examines the dynamic latency between human translators’ reading input and speaking output during reading aloud and sight translation. It aims to determine whether the temporal eye-voice span (EVS) at sentence level could work as a dynamic indicator of cognitive effort during speech processing. Thirty participants performed both the reading aloud and sight translation tasks with either English or Chinese texts. Their eye movements and speech outputs were recorded by an eye-tracker and an audio recorder, respectively. EVS at sentence-initial and sentence-terminal positions in the reading aloud and sight translation tasks were analyzed. The results show that the lengths of both sentence-initial and sentence-terminal EVS in sight translation tasks are significantly longer than those in reading aloud tasks. This is in line with the total gaze fixation duration and fixation count results, which are closely related to cognitive effort. Further correlation tests show that both initial and terminal EVS yield a positive although weak correlation with the fixation indexes in the sight translation tasks, while discrepant results emerge in the reading aloud tasks. Hence, we suggest that temporal EVS can be used to discriminate different types of reading-speaking tasks and has the potential to serve as a dynamic indicator of cognitive effort during sight translation.
Original languageEnglish
Title of host publicationAdvances in Cognitive Translation Studies
EditorsRicardo Muñoz Martín, Sanjun Sun, Defeng Li
PublisherSpringer
Pages161-179
ISBN (Electronic)978-981-16-2070-6
ISBN (Print)978-981-16-2069-0, 978-981-16-2072-0
DOIs
Publication statusPublished - 19 Nov 2021
Externally publishedYes

Publication series

NameNew Frontiers in Translation Studies
PublisherSpringer
ISSN (Print)2197-8689
ISSN (Electronic)2197-8697

Keywords

  • Eye-voice span
  • Eye-tracking
  • Sight translation
  • Reading aloud
  • Cognitive effort

Fingerprint

Dive into the research topics of 'Temporal Eye-Voice Span as a Dynamic Indicator for Cognitive Effort During Speech Processing: A Comparative Study of Reading Aloud and Sight Translation'. Together they form a unique fingerprint.

Cite this