EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Towards a Bidirectional Mexican Sign Language–Spanish Translation System: A Deep Learning Approach

Jaime-Rodrigo González-Rodríguez, Diana-Margarita Córdova-Esparza, Juan Terven, Julio-Alejandro Romero-González

Technologies · 05.01.2024 · 12 (1) · 7

DOI: 10.3390/technologies12010007 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Technologies, online erschienen am 05.01.2024. Verfasst von Jaime-Rodrigo González-Rodríguez und 3 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: IPN-SIP.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

People with hearing disabilities often face communication barriers when interacting with hearing individuals. To address this issue, this paper proposes a bidirectional Sign Language Translation System that aims to bridge the communication gap. Deep learning models such as recurrent neural networks (RNN), bidirectional RNN (BRNN), LSTM, GRU, and Transformers are compared to find the most accurate model for sign language recognition and translation. Keypoint detection using MediaPipe is employed to track and understand sign language gestures. The system features a user-friendly graphical interface with modes for translating between Mexican Sign Language (MSL) and Spanish in both directions. Users can input signs or text and obtain corresponding translations. Performance evaluation demonstrates high accuracy, with the BRNN model achieving 98.8% accuracy. The research emphasizes the importance of hand features in sign language recognition. Future developments could focus on enhancing accessibility and expanding the system to support other sign languages. This Sign Language Translation System offers a promising solution to improve communication accessibility and foster inclusivity for individuals with hearing disabilities.

Förderung

  • IPN-SIP

Zitieren

APA

González-Rodríguez, J., Córdova-Esparza, D., Terven, J., & Romero-González, J. (2024). Towards a Bidirectional Mexican Sign Language–Spanish Translation System: A Deep Learning Approach. Technologies, 12(1), 7. https://doi.org/10.3390/technologies12010007

Vancouver

González-Rodríguez J, Córdova-Esparza D, Terven J, Romero-González J. Towards a Bidirectional Mexican Sign Language–Spanish Translation System: A Deep Learning Approach. Technologies. 2024;12(1):7. doi:10.3390/technologies12010007

BibTeX
@article{GonzlezRodrguez2024,
  author = {González-Rodríguez, Jaime-Rodrigo and Córdova-Esparza, Diana-Margarita and Terven, Juan and Romero-González, Julio-Alejandro},
  title = {Towards a Bidirectional Mexican Sign Language–Spanish Translation System: A Deep Learning Approach},
  journal = {Technologies},
  year = {2024},
  volume = {12},
  number = {1},
  pages = {7},
  doi = {10.3390/technologies12010007}
}
Kostenlos starten →