Real-Time Multi-Sign Language Recognition and Translation
Engineering and Technology Journal · 29.05.2026 · 11 (05)
DOI: 10.47191/etj/v11i05.52 ↗Kurz gefasst
Fachartikel in der Zeitschrift Engineering and Technology Journal, online erschienen am 29.05.2026. Verfasst von Dr. Tabasum Guledgud und 5 weiteren Autor:innen.
Abstract (Originalsprache)
Sign language constitutes the primary mode of communication for an estimated 466 million deaf and hard-of-hearing individuals worldwide, yet the overwhelming majority of hearing individuals cannot understand it. Existing sign language recognition and translation systems address only a single sign language in isolation, are limited to static gestures or a small lexicon, lack real-time bidirectional translation, and fail to support multiple regional sign languages simultaneously. This paper proposes UnifySign: a unified, AI-powered, real-time framework for multi-sign language recognition and translation, supporting Indian Sign Language (ISL), American Sign Language (ASL), Pakistan Sign Language (PSL), and Indo-Pakistani Sign Language (IPSL). The system integrates YOLOv8 for bounding-box detection, MediaPipe Holistic for 21-point hand landmark extraction, Convolutional Neural Networks (CNN) for static sign classification, Long Short-Term Memory (LSTM) networks for dynamic gesture sequence recognition, and a Large Language Model (Google Flan-T5) for grammatically coherent sentence generation. A bidirectional translation pipeline supports both sign-to-text and speech/text-to-sign directions. Offline mobile deployment (Flutter + TFLite) and a web-based interface (Flask) ensure accessibility across device types. Experimental evaluation on INCLUDE, MS-ASL, WLASL, and a custom PSL/IPSL corpus demonstrates accuracy exceeding 97% for ISL/ASL static recognition, 95% for dynamic gestures, and 91% for sentence-level translation. The proposed system surpasses all ten reviewed state-of-the-art systems in coverage, accuracy, and real-world deployability.
Zitieren
APA
Guledgud, D. T., Hugar, M. S., V, M. R., patil, M. S., A, M. S., & A, M. U. (2026). Real-Time Multi-Sign Language Recognition and Translation. Engineering and Technology Journal, 11(05). https://doi.org/10.47191/etj/v11i05.52
Vancouver
Guledgud DT, Hugar MS, V MR, patil MS, A MS, A MU. Real-Time Multi-Sign Language Recognition and Translation. Engineering and Technology Journal. 2026;11(05). doi:10.47191/etj/v11i05.52
BibTeX
@article{Guledgud2026,
author = {Guledgud, Dr. Tabasum and Hugar, Mr. Siddarth and V, Ms. Rakshita and patil, Ms. Soumya and A, Ms. Sushmita and A, Ms. Usha},
title = {Real-Time Multi-Sign Language Recognition and Translation},
journal = {Engineering and Technology Journal},
year = {2026},
volume = {11},
number = {05},
doi = {10.47191/etj/v11i05.52}
}
EUVIMED