Deep Learning-Based Sign-To-Speech Interpretation
International Journal for Research in Applied Science and Engineering Technology · 31.03.2026 · 14 (3) · 1368-1376
DOI: 10.22214/ijraset.2026.78173 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal for Research in Applied Science and Engineering Technology, online erschienen am 31.03.2026. Verfasst von Mrs. J. Madhuri und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
Sign language detection system designed to assist individuals with hearing and speech impairments by enabling seamless communication. The study explores the application of advanced computer vision and deep learning techniques to interpret and translate sign language gestures into text or speech. By leveraging Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs), the system effectively recognizes and understands hand movements, finger positions, and complex gestures. These neural networks are trained on a large dataset containing diverse sign language examples, allowing the system to improve accuracy and adapt to various users. To enhance adaptability, transfer learning is implemented, enabling the system to learn new sign languages without requiring extensive new datasets. This approach ensures that the model can support multiple sign languages and dialects, making it a versatile tool for global accessibility. Real-time processing is a crucial aspect of the system, achieved through the use of lightweight client-side models that operate efficiently on edge devices such as smartphones, tablets, and embedded systems. This reduces dependency on cloud services, ensuring low latency and fast communication, which is essential for practical usage in everyday interactions. Additionally, the system incorporates Media Pipe for hand tracking and OpenCV for real-time video analysis, ensuring robustness under varying lighting conditions, backgrounds, and hand orientations. The goal of this research is to develop an inclusive communication tool that bridges the gap between sign language users and those unfamiliar with sign language. By making sign language translation more accessible, the project promotes social inclusion, educational opportunities, and workplace integration for the deaf and hard-of-hearing community. This work lays the foundation for future advancements, including gesture-based AI assistants, smart wearable devices, and multilingual sign language recognition, further enhancing accessibility worldwide.
Zitieren
APA
Madhuri, M. J., & Mounika, M. M. (2026). Deep Learning-Based Sign-To-Speech Interpretation. International Journal for Research in Applied Science and Engineering Technology, 14(3), 1368-1376. https://doi.org/10.22214/ijraset.2026.78173
Vancouver
Madhuri MJ, Mounika MM. Deep Learning-Based Sign-To-Speech Interpretation. International Journal for Research in Applied Science and Engineering Technology. 2026;14(3):1368-1376. doi:10.22214/ijraset.2026.78173
BibTeX
@article{Madhuri2026,
author = {Madhuri, Mrs. J. and Mounika, Mrs. M.},
title = {Deep Learning-Based Sign-To-Speech Interpretation},
journal = {International Journal for Research in Applied Science and Engineering Technology},
year = {2026},
volume = {14},
number = {3},
pages = {1368--1376},
doi = {10.22214/ijraset.2026.78173}
}
EUVIMED