EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Listen or Read? The Impact of Proficiency and Visual Complexity on Learners’ Reliance on Captions

Yan Li iD

Behavioral Sciences · 17.04.2025 · 15 (4) · 542

DOI: 10.3390/bs15040542 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Behavioral Sciences, online erschienen am 17.04.2025. Verfasst von Yan Li. Beteiligte Einrichtung: School of Foreign Languages and Cultures, Jilin University, Changchun 130012, China. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study investigates how Chinese EFL (English as a foreign language) learners of low- and high-proficiency levels allocate attention between captions and audio while watching videos, and how visual complexity (single- vs. multi-speaker content) influences caption reliance. The study employed a novel paused transcription method to assess real-time processing. A total of 64 participants (31 low-proficiency [A1–A2] and 33 high-proficiency [C1–C2] learners) viewed single- and multi-speaker videos with English captions. Misleading captions were inserted to objectively measure reliance on captions versus audio. Results revealed significant proficiency effects: Low-proficiency learners prioritized captions (reading scores > listening, Z = −4.55, p < 0.001, r = 0.82), while high-proficiency learners focused on audio (listening > reading, Z = −5.12, p < 0.001, r = 0.89). Multi-speaker videos amplified caption reliance for low-proficiency learners (r = 0.75) and moderately increased reliance for high-proficiency learners (r = 0.52). These findings demonstrate that low-proficiency learners rely overwhelmingly on captions during video viewing, while high-proficiency learners integrate multimodal inputs. Notably, increased visual complexity amplifies caption reliance across proficiency levels. Implications are twofold: Pedagogically, educators could design tiered caption removal protocols as skills improve while incorporating adjustable caption opacity tools. Technologically, future research could focus on developing dynamic captioning systems leveraging eye-tracking and AI to adapt to real-time proficiency, optimizing learning experiences. Additionally, video complexity should be calibrated to learners’ proficiency levels.

Schlagwörter

Stichwörter der Autor:innen

captioned videosdesirable difficultieslanguage processinglistening skillsproficiency levelsvideo complexity

Autor:innen und Institutionen

  • School of Foreign Languages and Cultures, Jilin University, Changchun 130012, China.

ORCID-Profile: Yan Li

Zitieren

APA

Li, Y. (2025). Listen or Read? The Impact of Proficiency and Visual Complexity on Learners’ Reliance on Captions. Behavioral Sciences, 15(4), 542. https://doi.org/10.3390/bs15040542

Vancouver

Li Y. Listen or Read? The Impact of Proficiency and Visual Complexity on Learners’ Reliance on Captions. Behavioral Sciences. 2025;15(4):542. doi:10.3390/bs15040542

BibTeX
@article{Li2025,
  author = {Li, Yan},
  title = {Listen or Read? The Impact of Proficiency and Visual Complexity on Learners’ Reliance on Captions},
  journal = {Behavioral Sciences},
  year = {2025},
  volume = {15},
  number = {4},
  pages = {542},
  doi = {10.3390/bs15040542}
}
Kostenlos starten →