EUVIMEDEUVIMED entdecken
Crossref

GANet: multi-modal adaptation continuous sign language recognition via gloss-aware network

Qi Chu, Shuang Xu, Yuehang Wang, Yongji Zhang, Qianren Guo, Hongde Qin, Yu Jiang

Complex Engineering Systems · 29.04.2026 · 6 (2)

DOI: 10.20517/ces.2025.79 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Complex Engineering Systems, online erschienen am 29.04.2026. Verfasst von Qi Chu und 6 weiteren Autor:innen. Die Arbeit nennt 65 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Continuous sign language recognition (CSLR) aims to model the temporal evolution of visual gestures to recognize continuous semantic units, which is of great significance for applications in deaf communication assistance and intelligent human–computer interaction. While existing methods emphasize local segment modeling and long-range dependency capture, they often overlook the critical role of global semantic context in overall video comprehension—an oversight that contradicts the inherently context-dependent nature of sign language. Moreover, sign language videos frequently contain a large number of visually similar but semantically meaningless motions. These misleading segments are easily misperceived as valid glosses, thereby degrading recognition accuracy. To address these challenges, we propose GANet (Gloss-Aware Network), a novel CSLR framework with cross-modal input adaptability. Inspired by the hierarchical structure of "book–chapter–content", GANet explicitly models global context to guide local understanding while effectively suppressing irrelevant motion noise. Specifically, we introduce a Global Context Modeling Module to capture semantic patterns across frames and an auxiliary task to enhance the model's ability to learn high-level structural semantics. In addition, we propose a Gloss-Aware Module that leverages global semantics to model the spatiotemporal occurrence of glosses, thereby improving the recognition of meaningful gestures. Extensive experiments on multiple benchmark datasets demonstrate that GANet outperforms existing methods, validating its effectiveness, robustness, and broad adaptability to both RGB (red, green, and blue) and event-based data.

Zitieren

APA

Chu, Q., Xu, S., Wang, Y., Zhang, Y., Guo, Q., Qin, H., & Jiang, Y. (2026). GANet: multi-modal adaptation continuous sign language recognition via gloss-aware network. Complex Engineering Systems, 6(2). https://doi.org/10.20517/ces.2025.79

Vancouver

Chu Q, Xu S, Wang Y, Zhang Y, Guo Q, Qin H, et al. GANet: multi-modal adaptation continuous sign language recognition via gloss-aware network. Complex Engineering Systems. 2026;6(2). doi:10.20517/ces.2025.79

BibTeX
@article{Chu2026,
  author = {Chu, Qi and Xu, Shuang and Wang, Yuehang and Zhang, Yongji and Guo, Qianren and Qin, Hongde and Jiang, Yu},
  title = {GANet: multi-modal adaptation continuous sign language recognition via gloss-aware network},
  journal = {Complex Engineering Systems},
  year = {2026},
  volume = {6},
  number = {2},
  doi = {10.20517/ces.2025.79}
}
Kostenlos starten →