EUVIMEDEUVIMED entdecken
Crossref

SignSense AI: Transformer Based Indian Sign Language Recognition Using Key-Point Features

Ms. Jeevitha Joseph, Dhulipala Koushik, Pagadala Rahul Naidu

INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · 15.04.2026 · 10 (04) · 1-9

DOI: 10.55041/ijsrem60161 ↗

Kurz gefasst

Fachartikel in der Zeitschrift INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, online erschienen am 15.04.2026. Verfasst von Ms. Jeevitha Joseph und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deaf and hard-of-hearing communities rely on sign languages as their primary mode of communication, yet automated systems capable of interpreting these languages accurately and efficiently remain limited — particularly for Indian Sign Language. This work presents a gesture recognition architecture that departs from conventional image-based pipelines by operating entirely on structured body and hand landmark sequences extracted using MediaPipe. A Transformer encoder processes these sequences, exploiting parallel self-attention to capture the temporal dependencies that define meaningful signing gestures. The system is benchmarked on the INCLUDE dataset across two vocabulary scales: a 150-class configuration and the full 263-class collection. On the smaller configuration, the model attains 94% classification accuracy; on the full vocabulary, it achieves 90% — outperforming CNN and hybrid LSTM-GRU baselines in both settings. The compact landmark representation keeps inference computationally tractable, making the system a viable candidate for real-time assistive communication applications. These findings suggest that pairing geometric feature extraction with attention-based sequence modeling offers a scalable and practically deployable path toward ISL recognition. Keywords: Indian Sign Language, gesture recognition, landmark extraction, Transformer encoder, MediaPipe, temporal modeling, assistive communication.

Zitieren

APA

Joseph, M. J., Koushik, D., & Naidu, P. R. (2026). SignSense AI: Transformer Based Indian Sign Language Recognition Using Key-Point Features. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, 10(04), 1-9. https://doi.org/10.55041/ijsrem60161

Vancouver

Joseph MJ, Koushik D, Naidu PR. SignSense AI: Transformer Based Indian Sign Language Recognition Using Key-Point Features. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT. 2026;10(04):1-9. doi:10.55041/ijsrem60161

BibTeX
@article{Joseph2026,
  author = {Joseph, Ms. Jeevitha and Koushik, Dhulipala and Naidu, Pagadala Rahul},
  title = {SignSense AI: Transformer Based Indian Sign Language Recognition Using Key-Point Features},
  journal = {INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT},
  year = {2026},
  volume = {10},
  number = {04},
  pages = {1--9},
  doi = {10.55041/ijsrem60161}
}
Kostenlos starten →