SignBridgeAI: An AI-Powered Multimodal Two-Way Communication System for Deaf, Mute and Hearing Users
INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · 21.10.2025 · 09 (10) · 1-9
DOI: 10.55041/ijsrem53148 ↗Kurz gefasst
Fachartikel in der Zeitschrift INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, online erschienen am 21.10.2025. Verfasst von Prof. Nikhil Deshpande und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
- SignBridgeAI is an AI-powered, multimodal platform designed to bridge communication barriers between deaf, mute, and hearing individuals through Indian Sign Language (ISL). The system integrates real-time gesture recognition leveraging MediaPipe and deep neural architectures (CNN and LSTM) for precise ISL sign classification. Speech-to-text conversion via Whisper API and the generation of 3D animated avatars using Unity further facilitate accessible two-way communication. Supporting a comprehensive dataset of 293 ISL gestures with customizable features, SignBridgeAI enables robust interaction suited for diverse user needs. Experimental evaluation demonstrates high recognition accuracy (97.25% for signs, 95% for speech-to-text) and low latency performance, validating its effectiveness for real-time use. The solution advances accessibility and social inclusion for the deaf community in India, and its scalable, device-agnostic design positions it as a practical assistive technology for broader societal integration. · Key Words: Indian Sign Language (ISL), Sign Language Recognition, AI-Powered Communication, Gesture Recognition, Deep Learning, Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM), Speech-to-Text Conversion, 3D Animated Avatars, Assistive Technology, Real-Time Translation, Multimodal Communication, Accessibility in Technology, Inclusive Communication, Human-Computer Interaction
Zitieren
APA
Deshpande, P. N., Ghodake, S., Gavandi, S., Gambhir, K., & Bangale, G. (2025). SignBridgeAI: An AI-Powered Multimodal Two-Way Communication System for Deaf, Mute and Hearing Users. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, 09(10), 1-9. https://doi.org/10.55041/ijsrem53148
Vancouver
Deshpande PN, Ghodake S, Gavandi S, Gambhir K, Bangale G. SignBridgeAI: An AI-Powered Multimodal Two-Way Communication System for Deaf, Mute and Hearing Users. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT. 2025;09(10):1-9. doi:10.55041/ijsrem53148
BibTeX
@article{Deshpande2025,
author = {Deshpande, Prof. Nikhil and Ghodake, Shreya and Gavandi, Sadiya and Gambhir, Kshiti and Bangale, Gauri},
title = {SignBridgeAI: An AI-Powered Multimodal Two-Way Communication System for Deaf, Mute and Hearing Users},
journal = {INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT},
year = {2025},
volume = {09},
number = {10},
pages = {1--9},
doi = {10.55041/ijsrem53148}
}
EUVIMED