EUVIMEDEUVIMED entdecken
Crossref

Signtalk: Unlocking Communication for Real-Time Sign Language and Audio Translation with Emotion Awareness

Dinesh Kumar. S, Diwakar. S, Dr. Ramesh Babu V., Dr. G. Victo Sudha George, Dr. Rehkha K.K

International Scientific Journal of Engineering and Management · 31.03.2026 · 05 (03) · 1-9

DOI: 10.55041/isjem05939 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Scientific Journal of Engineering and Management, online erschienen am 31.03.2026. Verfasst von Dinesh Kumar. S und 4 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

SignTalk is a real-time, bi-directional communication system designed to bridge the communication gap between deaf or hard-of- hearing individuals and non-sign language users. The system translates sign language gestures into text or speech and converts spoken language into sign language representations, preserving the emotional context. Computer vision techniques are used to capture hand gestures and facial expressions, which are processed using MediaPipe for accurate landmark extraction. A hybrid Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) model is employed to recognize continuous American Sign Language (ASL) gestures. Speech-to Text (STT) and Text- to-Speech (TTS) APIs facilitate seamless audio- to-text conversion, while Natural Language Processing (NLP) techniques enable linguistic mapping. Experimental evaluation using real- time webcam input demonstrates stable performance with low latency and reliable gesture recognition. The proposed system enhances accessibility and inclusivity in education, healthcare, and public service environments.

Zitieren

APA

S, D. K., S, D., V., D. R. B., George, D. G. V. S., & K.K, D. R. (2026). Signtalk: Unlocking Communication for Real-Time Sign Language and Audio Translation with Emotion Awareness. International Scientific Journal of Engineering and Management, 05(03), 1-9. https://doi.org/10.55041/isjem05939

Vancouver

S DK, S D, V. DRB, George DGVS, K.K DR. Signtalk: Unlocking Communication for Real-Time Sign Language and Audio Translation with Emotion Awareness. International Scientific Journal of Engineering and Management. 2026;05(03):1-9. doi:10.55041/isjem05939

BibTeX
@article{S2026,
  author = {S, Dinesh Kumar. and S, Diwakar. and V., Dr. Ramesh Babu and George, Dr. G. Victo Sudha and K.K, Dr. Rehkha},
  title = {Signtalk: Unlocking Communication for Real-Time Sign Language and Audio Translation with Emotion Awareness},
  journal = {International Scientific Journal of Engineering and Management},
  year = {2026},
  volume = {05},
  number = {03},
  pages = {1--9},
  doi = {10.55041/isjem05939}
}
Kostenlos starten →