Listen or Read? The Impact of Proficiency and Visual Complexity on Learners’ Reliance on Captions
Behavioral Sciences · 17.04.2025 · 15 (4) · 542
DOI: 10.3390/bs15040542 ↗Kurz gefasst
Fachartikel in der Zeitschrift Behavioral Sciences, online erschienen am 17.04.2025. Verfasst von Yan Li. Beteiligte Einrichtung: School of Foreign Languages and Cultures, Jilin University, Changchun 130012, China. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This study investigates how Chinese EFL (English as a foreign language) learners of low- and high-proficiency levels allocate attention between captions and audio while watching videos, and how visual complexity (single- vs. multi-speaker content) influences caption reliance. The study employed a novel paused transcription method to assess real-time processing. A total of 64 participants (31 low-proficiency [A1–A2] and 33 high-proficiency [C1–C2] learners) viewed single- and multi-speaker videos with English captions. Misleading captions were inserted to objectively measure reliance on captions versus audio. Results revealed significant proficiency effects: Low-proficiency learners prioritized captions (reading scores > listening, Z = −4.55, p < 0.001, r = 0.82), while high-proficiency learners focused on audio (listening > reading, Z = −5.12, p < 0.001, r = 0.89). Multi-speaker videos amplified caption reliance for low-proficiency learners (r = 0.75) and moderately increased reliance for high-proficiency learners (r = 0.52). These findings demonstrate that low-proficiency learners rely overwhelmingly on captions during video viewing, while high-proficiency learners integrate multimodal inputs. Notably, increased visual complexity amplifies caption reliance across proficiency levels. Implications are twofold: Pedagogically, educators could design tiered caption removal protocols as skills improve while incorporating adjustable caption opacity tools. Technologically, future research could focus on developing dynamic captioning systems leveraging eye-tracking and AI to adapt to real-time proficiency, optimizing learning experiences. Additionally, video complexity should be calibrated to learners’ proficiency levels.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Foreign Languages and Cultures, Jilin University, Changchun 130012, China.
ORCID-Profile: Yan Li
Zitieren
APA
Li, Y. (2025). Listen or Read? The Impact of Proficiency and Visual Complexity on Learners’ Reliance on Captions. Behavioral Sciences, 15(4), 542. https://doi.org/10.3390/bs15040542
Vancouver
Li Y. Listen or Read? The Impact of Proficiency and Visual Complexity on Learners’ Reliance on Captions. Behavioral Sciences. 2025;15(4):542. doi:10.3390/bs15040542
BibTeX
@article{Li2025,
author = {Li, Yan},
title = {Listen or Read? The Impact of Proficiency and Visual Complexity on Learners’ Reliance on Captions},
journal = {Behavioral Sciences},
year = {2025},
volume = {15},
number = {4},
pages = {542},
doi = {10.3390/bs15040542}
}
EUVIMED