EUVIMEDEUVIMED entdecken
Crossref

AI-Based Real-Time Speech-to-Sign Language Translation System for Assistive Communication

Y. Dayanand Kumar Y. Dayanand Kumar, Bhukya Siddhu Bhukya Siddhu

International Journal of Creative and Open Research in Engineering and Management · 09.05.2026 · 02 (05) · 1-4

DOI: 10.55041/ijcope.v2i5.279 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Creative and Open Research in Engineering and Management, online erschienen am 09.05.2026. Verfasst von Y. Dayanand Kumar Y. Dayanand Kumar und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents the design and development of an Artificial Intelligence (AI)-based, real-time Speech-to- Indian Sign Language (ISL) Translation System that bridges the communication gap between the hearing population and the deaf and hard-of-hearing community. The proposed system captures spoken audio via a standard microphone, converts it to text using cloud-based Automatic Speech Recognition (ASR), applies Natural Language Processing (NLP) techniques including tokenization, stop-word removal, and sentence sim- plification, and maps the resulting tokens to pre-recorded ISL GIF animations for sequential visual display. Implemented as a software-only Flask web application, the system requires no specialized hardware such as sensor gloves or motion-capture devices, enabling deployment on any standard browser-equipped device. A modular pipeline architecture ensures that individual components can be independently upgraded without disrupting the overall system. Experimental evaluation demonstrates high gesture-mapping accuracy for common vocabulary in controlled conditions, with near-real-time response latency suitable for conversational use. Out-of-vocabulary words are handled via a finger-spelling fallback mechanism, ensuring uninterrupted communication. Results confirm that an accessible, cost-effective, and scalable speech-to-sign translation tool can be realized using widely available web technologies and AI-driven NLP, address- ing limitations of existing hardware-dependent approaches and advancing social inclusion for the deaf community. Index Terms—Automatic Speech Recognition (ASR), Indian Sign Language (ISL), Natural Language Processing (NLP), As- sistive Communication Technology, GIF-Based Gesture Mapping, Real-Time Translation, Flask Web Application.

Zitieren

APA

Kumar, Y. D. K. Y. D., & Siddhu, B. S. B. (2026). AI-Based Real-Time Speech-to-Sign Language Translation System for Assistive Communication. International Journal of Creative and Open Research in Engineering and Management, 02(05), 1-4. https://doi.org/10.55041/ijcope.v2i5.279

Vancouver

Kumar YDKYD, Siddhu BSB. AI-Based Real-Time Speech-to-Sign Language Translation System for Assistive Communication. International Journal of Creative and Open Research in Engineering and Management. 2026;02(05):1-4. doi:10.55041/ijcope.v2i5.279

BibTeX
@article{Kumar2026,
  author = {Kumar, Y. Dayanand Kumar Y. Dayanand and Siddhu, Bhukya Siddhu Bhukya},
  title = {AI-Based Real-Time Speech-to-Sign Language Translation System for Assistive Communication},
  journal = {International Journal of Creative and Open Research in Engineering and Management},
  year = {2026},
  volume = {02},
  number = {05},
  pages = {1--4},
  doi = {10.55041/ijcope.v2i5.279}
}
Kostenlos starten →