SignSense AI: Transformer Based Indian Sign Language Recognition Using Key-Point Features
INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · 15.04.2026 · 10 (04) · 1-9
DOI: 10.55041/ijsrem60161 ↗Kurz gefasst
Fachartikel in der Zeitschrift INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, online erschienen am 15.04.2026. Verfasst von Ms. Jeevitha Joseph und 2 weiteren Autor:innen.
Abstract (Originalsprache)
Deaf and hard-of-hearing communities rely on sign languages as their primary mode of communication, yet automated systems capable of interpreting these languages accurately and efficiently remain limited — particularly for Indian Sign Language. This work presents a gesture recognition architecture that departs from conventional image-based pipelines by operating entirely on structured body and hand landmark sequences extracted using MediaPipe. A Transformer encoder processes these sequences, exploiting parallel self-attention to capture the temporal dependencies that define meaningful signing gestures. The system is benchmarked on the INCLUDE dataset across two vocabulary scales: a 150-class configuration and the full 263-class collection. On the smaller configuration, the model attains 94% classification accuracy; on the full vocabulary, it achieves 90% — outperforming CNN and hybrid LSTM-GRU baselines in both settings. The compact landmark representation keeps inference computationally tractable, making the system a viable candidate for real-time assistive communication applications. These findings suggest that pairing geometric feature extraction with attention-based sequence modeling offers a scalable and practically deployable path toward ISL recognition. Keywords: Indian Sign Language, gesture recognition, landmark extraction, Transformer encoder, MediaPipe, temporal modeling, assistive communication.
Zitieren
APA
Joseph, M. J., Koushik, D., & Naidu, P. R. (2026). SignSense AI: Transformer Based Indian Sign Language Recognition Using Key-Point Features. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, 10(04), 1-9. https://doi.org/10.55041/ijsrem60161
Vancouver
Joseph MJ, Koushik D, Naidu PR. SignSense AI: Transformer Based Indian Sign Language Recognition Using Key-Point Features. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT. 2026;10(04):1-9. doi:10.55041/ijsrem60161
BibTeX
@article{Joseph2026,
author = {Joseph, Ms. Jeevitha and Koushik, Dhulipala and Naidu, Pagadala Rahul},
title = {SignSense AI: Transformer Based Indian Sign Language Recognition Using Key-Point Features},
journal = {INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT},
year = {2026},
volume = {10},
number = {04},
pages = {1--9},
doi = {10.55041/ijsrem60161}
}
EUVIMED