Adapting to imperfect technology: A time-course eye-tracking study of students’ cognitive engagement with ASR captions in simultaneous interpreting
Language Learning & Technology · 2026 · 30 (1) · 1-20
DOI: 10.64152/10125/73718 ↗Kurz gefasst
Fachartikel in der Zeitschrift Language Learning & Technology, 2026. Verfasst von Xingcheng Ma und 1 weiteren Autor:innen. Die Arbeit nennt 47 Literaturangaben.
Abstract (Originalsprache)
Automatic speech recognition (ASR) is increasingly used in interpreter education, yet how student interpreters cognitively engage with imperfect ASR captions remains underexplored. Drawing on cognitive engagement and Cognitive Load Theory, this study examined how task-intrinsic load, operationalised as syntactic complexity, and technology-induced extraneous load, operationalised as ASR caption errors, jointly shaped students’ real-time engagement during simultaneous interpreting. Twenty-five postgraduate interpreting students completed ASR-supported interpreting tasks while their eye movements and item-level interpreting accuracy were recorded. A time-course eye-tracking approach was used to capture moment-by-moment responses around manipulated caption events. Results showed that engagement with ASR captions was selective and multidimensional. Students increased visual attention to captions under high syntactic complexity only when captions were correct, whereas this complexity-driven reliance disappeared when captions contained errors. Blink suppression was mainly associated with high syntactic complexity, suggesting sustained attentional engagement. Pupil-size patterns suggested fluctuating effortful processing, with minor errors eliciting greater temporal variation than severe errors under high complexity. Interpreting accuracy declined when captions contained errors, especially severe errors. These findings show that ASR-supported interpreting involves selective attention allocation and effort regulation under competing intrinsic and extraneous demands, highlighting the need for training in strategic caption use and cognitive flexibility.
Zitieren
APA
Ma, X., & Zhong, L. (2026). Adapting to imperfect technology: A time-course eye-tracking study of students’ cognitive engagement with ASR captions in simultaneous interpreting. Language Learning & Technology, 30(1), 1-20. https://doi.org/10.64152/10125/73718
Vancouver
Ma X, Zhong L. Adapting to imperfect technology: A time-course eye-tracking study of students’ cognitive engagement with ASR captions in simultaneous interpreting. Language Learning & Technology. 2026;30(1):1-20. doi:10.64152/10125/73718
BibTeX
@article{Ma2026,
author = {Ma, Xingcheng and Zhong, Linping},
title = {Adapting to imperfect technology: A time-course eye-tracking study of students’ cognitive engagement with ASR captions in simultaneous interpreting},
journal = {Language Learning & Technology},
year = {2026},
volume = {30},
number = {1},
pages = {1--20},
doi = {10.64152/10125/73718}
}
EUVIMED