EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MediaPipe Frame and Convolutional Neural Networks-Based Fingerspelling Detection in Mexican Sign Language

Tzeico J. Sánchez-Vicinaiz, Enrique Camacho-Pérez, Alejandro A. Castillo-Atoche, Mayra Cruz-Fernandez, José R. García-Martínez, Juvenal Rodríguez-Reséndiz

Technologies · 01.08.2024 · 12 (8) · 124

DOI: 10.3390/technologies12080124 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Technologies, online erschienen am 01.08.2024. Verfasst von Tzeico J. Sánchez-Vicinaiz und 5 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This research proposes implementing a system to recognize the static signs of the Mexican Sign Language (MSL) dactylological alphabet using the MediaPipe frame and Convolutional Neural Network (CNN) models to correctly interpret the letters that represent the manual signals coming from a camera. The development of these types of studies allows the implementation of technological advances in artificial intelligence and computer vision in teaching Mexican Sign Language (MSL). The best CNN model achieved an accuracy of 83.63% over the sets of 336 test images. In addition, considering samples of each letter, the following results are obtained: an accuracy of 84.57%, a sensitivity of 83.33%, and a specificity of 99.17%. The advantage of this system is that it could be implemented on low-consumption equipment, carrying out the classification in real-time, contributing to the accessibility of its use.

Zitieren

APA

Sánchez-Vicinaiz, T. J., Camacho-Pérez, E., Castillo-Atoche, A. A., Cruz-Fernandez, M., García-Martínez, J. R., & Rodríguez-Reséndiz, J. (2024). MediaPipe Frame and Convolutional Neural Networks-Based Fingerspelling Detection in Mexican Sign Language. Technologies, 12(8), 124. https://doi.org/10.3390/technologies12080124

Vancouver

Sánchez-Vicinaiz TJ, Camacho-Pérez E, Castillo-Atoche AA, Cruz-Fernandez M, García-Martínez JR, Rodríguez-Reséndiz J. MediaPipe Frame and Convolutional Neural Networks-Based Fingerspelling Detection in Mexican Sign Language. Technologies. 2024;12(8):124. doi:10.3390/technologies12080124

BibTeX
@article{SnchezVicinaiz2024,
  author = {Sánchez-Vicinaiz, Tzeico J. and Camacho-Pérez, Enrique and Castillo-Atoche, Alejandro A. and Cruz-Fernandez, Mayra and García-Martínez, José R. and Rodríguez-Reséndiz, Juvenal},
  title = {MediaPipe Frame and Convolutional Neural Networks-Based Fingerspelling Detection in Mexican Sign Language},
  journal = {Technologies},
  year = {2024},
  volume = {12},
  number = {8},
  pages = {124},
  doi = {10.3390/technologies12080124}
}
Kostenlos starten →