EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Toward a Recognition System for Mexican Sign Language: Arm Movement Detection

Gabriela Hilario-Acuapan iD, Keny Ordaz-Hernández iD, Mario Castelán iD, Ismael Lopez-Juarez iD

Sensors · 2025

DOI: 10.3390/s25123636 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Gabriela Hilario-Acuapan und 3 weiteren Autor:innen. Beteiligte Einrichtung: Robotics and Advanced Manufacturing Department, Centre for Research and Advanced Studies (CINVESTAV), Ramos Arizpe 25900, Mexico. Hauptthemen laut MEDLINE: Sign Language, Arm. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 75 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Consejo Nacional de Humanidades, Ciencias y Tecnologías, CONAHCYT.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper describes ongoing work surrounding the creation of a recognition system for Mexican Sign Language (LSM). We propose a general sign decomposition that is divided into three parts, i.e., hand configuration (HC), arm movement (AM), and non-hand gestures (NHGs). This paper focuses on the AM features and reports the approach created to analyze visual patterns in arm joint movements (wrists, shoulders, and elbows). For this research, a proprietary dataset—one that does not limit the recognition of arm movements—was developed, with active participation from the deaf community and LSM experts. We analyzed two case studies involving three sign subsets. For each sign, the pose was extracted to generate shapes of the joint paths during the arm movements and fed to a CNN classifier. YOLOv8 was used for pose estimation and visual pattern classification purposes. The proposed approach, based on pose estimation, shows promising results for constructing CNN models to classify a wide range of signs.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Sign LanguageArmHumansMovementGesturesNeural Networks, ComputerAlgorithmsMexicoHand

Stichwörter der Autor:innen

CNNMexican Sign LanguageYOLOv8arm movementcomputer visiondynamic signsmachine learningpattern analysispose-based approach

Autor:innen und Institutionen

  • Robotics and Advanced Manufacturing Department, Centre for Research and Advanced Studies (CINVESTAV), Ramos Arizpe 25900, Mexico.

ORCID-Profile: Gabriela Hilario-Acuapan, Keny Ordaz-Hernández, Mario Castelán, Ismael Lopez-Juarez

Förderung

  • Consejo Nacional de Humanidades, Ciencias y Tecnologías
  • CONAHCYT

Zitieren

APA

Hilario-Acuapan, G., Ordaz-Hernández, K., Castelán, M., & Lopez-Juarez, I. (2025). Toward a Recognition System for Mexican Sign Language: Arm Movement Detection. Sensors. https://doi.org/10.3390/s25123636

Vancouver

Hilario-Acuapan G, Ordaz-Hernández K, Castelán M, Lopez-Juarez I. Toward a Recognition System for Mexican Sign Language: Arm Movement Detection. Sensors. 2025. doi:10.3390/s25123636

BibTeX
@article{HilarioAcuapan2025,
  author = {Hilario-Acuapan, Gabriela and Ordaz-Hernández, Keny and Castelán, Mario and Lopez-Juarez, Ismael},
  title = {Toward a Recognition System for Mexican Sign Language: Arm Movement Detection},
  journal = {Sensors},
  year = {2025},
  doi = {10.3390/s25123636}
}
Kostenlos starten →