EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

SSTA-ResT: Soft Spatiotemporal Attention ResNet Transformer for Argentine Sign Language Recognition

Xianru Liu, Zeru Zhou, E Xia iD, Xin Yin

Sensors · 2025

DOI: 10.3390/s25175543 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Xianru Liu und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Automation, Central South University, Changsha 410083, China. Hauptthemen laut MEDLINE: Sign Language. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sign language recognition technology serves as a crucial bridge, fostering meaningful connections between deaf individuals and hearing individuals. This technological innovation plays a substantial role in promoting social inclusivity. Conventional sign language recognition methodologies that rely on static images are inadequate for capturing the dynamic characteristics and temporal information inherent in sign language. This limitation restricts their practical applicability in real-world scenarios. The proposed framework, called SSTA-ResT, integrates ResNet, soft spatiotemporal attention, and Transformer encoders to achieve this objective. The framework utilizes ResNet to extract robust spatial feature representations, employs the lightweight SSTA module for dual-path complementary representation enhancement to strengthen spatiotemporal associations, and leverages the Transformer encoder to capture long-range temporal dependencies. Experimental results on the LSA64 Argentine Sign Language (ASL) dataset demonstrate that the proposed method achieves an accuracy of 96.25%, a precision of 97.18%, and an F1 score of 0.9671. These results surpass the performance of existing methods across all metrics while maintaining a relatively low model parameter count of 11.66 M. This demonstrates the framework’s effectiveness and practicality for sign language video recognition tasks.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Sign LanguageHumansAlgorithmsArgentina

Stichwörter der Autor:innen

Argentine Sign Language recognitionResNetTransformerspatiotemporal attention

Autor:innen und Institutionen

  • School of Automation, Central South University, Changsha 410083, China.
  • Information and Network Center, Central South University, Changsha 410083, China.

ORCID-Profile: E Xia

Zitieren

APA

Liu, X., Zhou, Z., Xia, E., & Yin, X. (2025). SSTA-ResT: Soft Spatiotemporal Attention ResNet Transformer for Argentine Sign Language Recognition. Sensors. https://doi.org/10.3390/s25175543

Vancouver

Liu X, Zhou Z, Xia E, Yin X. SSTA-ResT: Soft Spatiotemporal Attention ResNet Transformer for Argentine Sign Language Recognition. Sensors. 2025. doi:10.3390/s25175543

BibTeX
@article{Liu2025,
  author = {Liu, Xianru and Zhou, Zeru and Xia, E and Yin, Xin},
  title = {SSTA-ResT: Soft Spatiotemporal Attention ResNet Transformer for Argentine Sign Language Recognition},
  journal = {Sensors},
  year = {2025},
  doi = {10.3390/s25175543}
}
Kostenlos starten →