Multimodal Chinese Pronunciation Error Correction With IoT Integration
Internet Technology Letters · 2026-07 · 9 (4)
DOI: 10.1002/itl2.70312 ↗Kurz gefasst
Fachartikel in der Zeitschrift Internet Technology Letters, online erschienen am 15.06.2026. Verfasst von Xiaofeng Jin. Die Arbeit nennt 11 Literaturangaben.
Abstract (Originalsprache)
With the rapid globalization of Mandarin Chinese, the demand for effective oral training has shifted from static desktop applications to dynamic Real‐Time Communication (RTC) environments. Traditional systems often rely on unimodal acoustic analysis or high‐latency cloud‐based processing, which fail to provide the instantaneous feedback required for natural interaction. This paper proposes the Edge‐Assisted Multimodal Fusion Transformer (EAMFT), a novel framework specifically designed for the real‐time correction of Chinese pronunciation. Compared with representative Support Vector Machine (SVM)‐based approaches, EAMFT leverages a Cross‐Modal Attention (CMA) mechanism to synchronize acoustic features with visual articulatory movements (lip‐sync), significantly improving tonal classification accuracy in noisy environments. To address the strict latency requirements of RTC, we implement an edge‐cloud collaborative training policy and a Hysteresis‐based Correction Trigger (HCT) to ensure stable, nonintrusive feedback. Experimental results on the C‐Sino and L2‐ARCTIC corpora demonstrate that EAMFT achieves a recognition accuracy of 94.6% with an average end‐to‐end latency of only 65 ms, outperforming state‐of‐the‐art methods in both robustness and responsiveness.
Zitieren
APA
Jin, X. (2026). Multimodal Chinese Pronunciation Error Correction With IoT Integration. Internet Technology Letters, 9(4). https://doi.org/10.1002/itl2.70312
Vancouver
Jin X. Multimodal Chinese Pronunciation Error Correction With IoT Integration. Internet Technology Letters. 2026;9(4). doi:10.1002/itl2.70312
BibTeX
@article{Jin2026,
author = {Jin, Xiaofeng},
title = {Multimodal Chinese Pronunciation Error Correction With IoT Integration},
journal = {Internet Technology Letters},
year = {2026},
volume = {9},
number = {4},
doi = {10.1002/itl2.70312}
}
EUVIMED