EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

CMST-Net: Cross-Modal Interaction and Spatio-Temporal Feature Enhancement Method for Continuous Sign Language Recognition

Qiuhong Tian, Zhengzheng Li, Hanbo Zhang, Shiwei Ge, Jing Huang

Electronics · 2026-08-19 · 15 (16) · 3703

DOI: 10.3390/electronics15163703 ↗

At a glance

Journal article in Electronics, published online on 2026-08-19. Written by Qiuhong Tian and 4 co-authors. 61 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Natural Science Foundation of China, Zhejiang Province.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

In continuous sign language recognition (CSLR), existing methods predominantly adopt frame-wise feature extraction, neglecting temporal continuity and motion trajectory modeling, thereby struggling to capture complete spatio-temporal dynamics. Meanwhile, global cross-modal attention approaches typically directly model interactions between text and the entire video sequence but lack structural constraints, making them susceptible to interference from redundant frames, which leads to attention distribution dilution and undermines fine-grained motion alignment capability. To address these issues, this paper proposes CMST-Net, a Cross-modal Interaction and Spatio-temporal Feature Enhancement Method for Continuous Sign Language Recognition. CMST-Net comprises two principal modules: the Local–Global Cross-modal Fusion Module (LGCFM) and the Spatio-Temporal Feature Enhancement Module (STFEM). LGCFM introduces a synergistic modeling mechanism that combines local sliding-window attention with global attention, achieving a unified fusion of structured local alignment and global semantic modeling. STFEM incorporates multi-scale spatial dilated convolution and coordinate attention to extract fine-grained spatial features while leveraging channel partitioning and a hierarchical residual structure to enhance long-range temporal modeling capability; the two modules collaboratively yield high-quality spatio-temporal feature representations. Experiments on three public benchmark datasets (PHOENIX2014, PHOENIX2014-T, and CSL-Daily) demonstrate that CMST-Net can effectively improve continuous sign language recognition performance, achieving state-of-the-art performance on the PHOENIX2014 and CSL-Daily datasets and competitive results on the PHOENIX2014-T dataset.

Funding

  • National Natural Science Foundation of China
  • Zhejiang Province

Cite

APA

Tian, Q., Li, Z., Zhang, H., Ge, S., & Huang, J. (2026). CMST-Net: Cross-Modal Interaction and Spatio-Temporal Feature Enhancement Method for Continuous Sign Language Recognition. Electronics, 15(16), 3703. https://doi.org/10.3390/electronics15163703

Vancouver

Tian Q, Li Z, Zhang H, Ge S, Huang J. CMST-Net: Cross-Modal Interaction and Spatio-Temporal Feature Enhancement Method for Continuous Sign Language Recognition. Electronics. 2026;15(16):3703. doi:10.3390/electronics15163703

BibTeX
@article{Tian2026,
  author = {Tian, Qiuhong and Li, Zhengzheng and Zhang, Hanbo and Ge, Shiwei and Huang, Jing},
  title = {CMST-Net: Cross-Modal Interaction and Spatio-Temporal Feature Enhancement Method for Continuous Sign Language Recognition},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {16},
  pages = {3703},
  doi = {10.3390/electronics15163703}
}
Start for free →