Integrating dynamic temporal adjustment and multimodal language landscape translation: an innovative application for English language pedagogy
PeerJ Computer Science · 20.03.2026 · 12 · e3558
DOI: 10.7717/peerj-cs.3558 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 20.03.2026. Verfasst von Yanqi Hu. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Investigation and Research on the Current Situation of Digital Literacy of Primary and Secondary School Teachers in Shaanxi Province.
Abstract (Originalsprache)
Advances in information technology have accelerated the integration of computer-assisted instruction into English language teaching. Among these technological tools, dynamic time warping (DTW) algorithms have played a central role in enhancing pedagogical effectiveness. Nevertheless, issues related to computational efficiency, recognition speed, and accuracy remain unresolved. To address these challenges, this study introduces an innovative approach that combines an enhanced DTW algorithm with multimodal language landscapes, integrating speech, visual cues, and textual data to improve pronunciation and oral expression training for English learners. The optimized system exhibited notable performance: under 10 dB signal-to-noise ratio (SNR) conditions, it achieved recognition accuracies of 82.43% for multi-channel interference and 85.92% for white noise. These rates increased to 97.14% and 98.12%, respectively, at 20 dB SNR, and reached a peak of 99.03% in clean speech environments. The improved DTW algorithm attained a 90.64% gain in computational efficiency over conventional methods while sustaining a speech recognition success rate above 90%, with error margins limited to ±0.2, indicating high stability and precision. By incorporating multimodal linguistic contexts—such as visual articulatory gestures and contextual text—the system helps learners connect phonetic patterns with real-world communication scenarios, thereby closing the gap between theoretical language research and practical teaching requirements. These developments not only improve real-time adaptive feedback for pronunciation correction but also facilitate the diagnosis and resolution of learner-specific issues by educators. This study has laid the groundwork for a scalable framework to modernize language instruction, highlighting the potential of computationally robust and context-aware tools to transform foreign language education by aligning technological advances with learner-centered pedagogical processes.
Förderung
- Investigation and Research on the Current Situation of Digital Literacy of Primary and Secondary School Teachers in Shaanxi Province
Zitieren
APA
Hu, Y. (2026). Integrating dynamic temporal adjustment and multimodal language landscape translation: an innovative application for English language pedagogy. PeerJ Computer Science, 12, e3558. https://doi.org/10.7717/peerj-cs.3558
Vancouver
Hu Y. Integrating dynamic temporal adjustment and multimodal language landscape translation: an innovative application for English language pedagogy. PeerJ Computer Science. 2026;12:e3558. doi:10.7717/peerj-cs.3558
BibTeX
@article{Hu2026,
author = {Hu, Yanqi},
title = {Integrating dynamic temporal adjustment and multimodal language landscape translation: an innovative application for English language pedagogy},
journal = {PeerJ Computer Science},
year = {2026},
volume = {12},
pages = {e3558},
doi = {10.7717/peerj-cs.3558}
}
EUVIMED