SSTA-ResT: Soft Spatiotemporal Attention ResNet Transformer for Argentine Sign Language Recognition
Sensors · 2025
DOI: 10.3390/s25175543 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Xianru Liu und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Automation, Central South University, Changsha 410083, China. Hauptthemen laut MEDLINE: Sign Language. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Sign language recognition technology serves as a crucial bridge, fostering meaningful connections between deaf individuals and hearing individuals. This technological innovation plays a substantial role in promoting social inclusivity. Conventional sign language recognition methodologies that rely on static images are inadequate for capturing the dynamic characteristics and temporal information inherent in sign language. This limitation restricts their practical applicability in real-world scenarios. The proposed framework, called SSTA-ResT, integrates ResNet, soft spatiotemporal attention, and Transformer encoders to achieve this objective. The framework utilizes ResNet to extract robust spatial feature representations, employs the lightweight SSTA module for dual-path complementary representation enhancement to strengthen spatiotemporal associations, and leverages the Transformer encoder to capture long-range temporal dependencies. Experimental results on the LSA64 Argentine Sign Language (ASL) dataset demonstrate that the proposed method achieves an accuracy of 96.25%, a precision of 97.18%, and an F1 score of 0.9671. These results surpass the performance of existing methods across all metrics while maintaining a relatively low model parameter count of 11.66 M. This demonstrates the framework’s effectiveness and practicality for sign language video recognition tasks.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Automation, Central South University, Changsha 410083, China.
- Information and Network Center, Central South University, Changsha 410083, China.
ORCID-Profile: E Xia
Zitieren
APA
Liu, X., Zhou, Z., Xia, E., & Yin, X. (2025). SSTA-ResT: Soft Spatiotemporal Attention ResNet Transformer for Argentine Sign Language Recognition. Sensors. https://doi.org/10.3390/s25175543
Vancouver
Liu X, Zhou Z, Xia E, Yin X. SSTA-ResT: Soft Spatiotemporal Attention ResNet Transformer for Argentine Sign Language Recognition. Sensors. 2025. doi:10.3390/s25175543
BibTeX
@article{Liu2025,
author = {Liu, Xianru and Zhou, Zeru and Xia, E and Yin, Xin},
title = {SSTA-ResT: Soft Spatiotemporal Attention ResNet Transformer for Argentine Sign Language Recognition},
journal = {Sensors},
year = {2025},
doi = {10.3390/s25175543}
}
EUVIMED