Signtalk: Unlocking Communication for Real-Time Sign Language and Audio Translation with Emotion Awareness
International Scientific Journal of Engineering and Management · 31.03.2026 · 05 (03) · 1-9
DOI: 10.55041/isjem05939 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Scientific Journal of Engineering and Management, online erschienen am 31.03.2026. Verfasst von Dinesh Kumar. S und 4 weiteren Autor:innen.
Abstract (Originalsprache)
SignTalk is a real-time, bi-directional communication system designed to bridge the communication gap between deaf or hard-of- hearing individuals and non-sign language users. The system translates sign language gestures into text or speech and converts spoken language into sign language representations, preserving the emotional context. Computer vision techniques are used to capture hand gestures and facial expressions, which are processed using MediaPipe for accurate landmark extraction. A hybrid Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) model is employed to recognize continuous American Sign Language (ASL) gestures. Speech-to Text (STT) and Text- to-Speech (TTS) APIs facilitate seamless audio- to-text conversion, while Natural Language Processing (NLP) techniques enable linguistic mapping. Experimental evaluation using real- time webcam input demonstrates stable performance with low latency and reliable gesture recognition. The proposed system enhances accessibility and inclusivity in education, healthcare, and public service environments.
Zitieren
APA
S, D. K., S, D., V., D. R. B., George, D. G. V. S., & K.K, D. R. (2026). Signtalk: Unlocking Communication for Real-Time Sign Language and Audio Translation with Emotion Awareness. International Scientific Journal of Engineering and Management, 05(03), 1-9. https://doi.org/10.55041/isjem05939
Vancouver
S DK, S D, V. DRB, George DGVS, K.K DR. Signtalk: Unlocking Communication for Real-Time Sign Language and Audio Translation with Emotion Awareness. International Scientific Journal of Engineering and Management. 2026;05(03):1-9. doi:10.55041/isjem05939
BibTeX
@article{S2026,
author = {S, Dinesh Kumar. and S, Diwakar. and V., Dr. Ramesh Babu and George, Dr. G. Victo Sudha and K.K, Dr. Rehkha},
title = {Signtalk: Unlocking Communication for Real-Time Sign Language and Audio Translation with Emotion Awareness},
journal = {International Scientific Journal of Engineering and Management},
year = {2026},
volume = {05},
number = {03},
pages = {1--9},
doi = {10.55041/isjem05939}
}
EUVIMED