Chinese Lip-Reading Based on Residual Network and Attention Mechanism
International Journal of Innovative Science and Research Technology · 19.11.2026 · 11 (11) · 710
DOI: 10.38124/ijisrt/26nov599 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Innovative Science and Research Technology, online erschienen am 19.11.2026. Verfasst von Chuan Qin und 1 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben.
Abstract (Originalsprache)
To address the common issues in existing lip-reading recognition systems, such as insufficient feature extraction and visual ambiguities, a Chinese sentence-level lip-reading recognition system based on residual networks and attention mechanisms (Spatio-Temporal Cascade Network, STCNet) is proposed. This system can first translate continuous videos containing speakers into pinyin sequences sentence by sentence, and then convert them into continuous Chinese sentences. Firstly, the residual network in the front-end feature extraction module can achieve bidirectional transmission and fusion of multi-level features, enhancing the extraction capability of long-term temporal features. In the back-end pinyin classification module, a Temporal Convolutional Network (TCN) is used to extract long-term dependency information, and an attention mechanism is introduced to weight discriminative features at different time intervals to reduce visual ambiguities
Zitieren
APA
Qin, C., & Liu, Z. (2026). Chinese Lip-Reading Based on Residual Network and Attention Mechanism. International Journal of Innovative Science and Research Technology, 11(11), 710. https://doi.org/10.38124/ijisrt/26nov599
Vancouver
Qin C, Liu Z. Chinese Lip-Reading Based on Residual Network and Attention Mechanism. International Journal of Innovative Science and Research Technology. 2026;11(11):710. doi:10.38124/ijisrt/26nov599
BibTeX
@article{Qin2026,
author = {Qin, Chuan and Liu, ZiLong},
title = {Chinese Lip-Reading Based on Residual Network and Attention Mechanism},
journal = {International Journal of Innovative Science and Research Technology},
year = {2026},
volume = {11},
number = {11},
pages = {710},
doi = {10.38124/ijisrt/26nov599}
}
EUVIMED