Towards a Bidirectional Mexican Sign Language–Spanish Translation System: A Deep Learning Approach
Technologies · 05.01.2024 · 12 (1) · 7
DOI: 10.3390/technologies12010007 ↗Kurz gefasst
Fachartikel in der Zeitschrift Technologies, online erschienen am 05.01.2024. Verfasst von Jaime-Rodrigo González-Rodríguez und 3 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: IPN-SIP.
Abstract (Originalsprache)
People with hearing disabilities often face communication barriers when interacting with hearing individuals. To address this issue, this paper proposes a bidirectional Sign Language Translation System that aims to bridge the communication gap. Deep learning models such as recurrent neural networks (RNN), bidirectional RNN (BRNN), LSTM, GRU, and Transformers are compared to find the most accurate model for sign language recognition and translation. Keypoint detection using MediaPipe is employed to track and understand sign language gestures. The system features a user-friendly graphical interface with modes for translating between Mexican Sign Language (MSL) and Spanish in both directions. Users can input signs or text and obtain corresponding translations. Performance evaluation demonstrates high accuracy, with the BRNN model achieving 98.8% accuracy. The research emphasizes the importance of hand features in sign language recognition. Future developments could focus on enhancing accessibility and expanding the system to support other sign languages. This Sign Language Translation System offers a promising solution to improve communication accessibility and foster inclusivity for individuals with hearing disabilities.
Förderung
- IPN-SIP
Zitieren
APA
González-Rodríguez, J., Córdova-Esparza, D., Terven, J., & Romero-González, J. (2024). Towards a Bidirectional Mexican Sign Language–Spanish Translation System: A Deep Learning Approach. Technologies, 12(1), 7. https://doi.org/10.3390/technologies12010007
Vancouver
González-Rodríguez J, Córdova-Esparza D, Terven J, Romero-González J. Towards a Bidirectional Mexican Sign Language–Spanish Translation System: A Deep Learning Approach. Technologies. 2024;12(1):7. doi:10.3390/technologies12010007
BibTeX
@article{GonzlezRodrguez2024,
author = {González-Rodríguez, Jaime-Rodrigo and Córdova-Esparza, Diana-Margarita and Terven, Juan and Romero-González, Julio-Alejandro},
title = {Towards a Bidirectional Mexican Sign Language–Spanish Translation System: A Deep Learning Approach},
journal = {Technologies},
year = {2024},
volume = {12},
number = {1},
pages = {7},
doi = {10.3390/technologies12010007}
}
EUVIMED