EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Virtual Trainer for Learning Mexican Sign Language Using Video Similarity Analysis

Felipe de Jesús Rivera-Cervantes, Diana-Margarita Córdova-Esparza, Juan Terven, Julio-Alejandro Romero-González, Jaime-Rodrigo González-Rodríguez, Mauricio-Arturo Ibarra-Corona, Pedro-Alfonso Ramírez-Pedraza

Technologies · 21.11.2025 · 13 (12) · 540

DOI: 10.3390/technologies13120540 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Technologies, online erschienen am 21.11.2025. Verfasst von Felipe de Jesús Rivera-Cervantes und 6 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Learning Mexican Sign Language (MSL) benefits from interactive systems that provide immediate feedback without requiring specialized sensors. This work presents a virtual training platform that operates with a conventional RGB camera and applies computer vision techniques to guide learners in real time. A dataset of 335 videos was recorded across 12 lessons with professional interpreters and used as the reference material for practice sessions. From each video, 48 keypoints corresponding to hands and facial landmarks were extracted using MediaPipe, normalized, and compared with user trajectories through Dynamic Time Warping (DTW). A sign is accepted when the DTW distance is below a similarity threshold, allowing users to receive quantitative feedback on performance. Additionally, an experimental baseline using video embeddings generated by the Qwen2.5-VL, VideoMAEv2, and VJEPA2 models and classified via Matching Networks was evaluated for scalability. Results show that the DTW-based module provides accurate and interpretable feedback for guided practice with minimal computational cost, while the embedding-based approach serves as an exploratory baseline for larger-scale classification and semi-automatic labeling. A user study with 33 participants evidenced feasibility and perceived usefulness (all category means significantly above neutral; Cronbach’s α=0.81). Overall, the proposed framework offers an accessible, low-cost, and effective solution for inclusive MSL education and represents a promising foundation for future multimodal sign-language learning tools.

Zitieren

APA

Rivera-Cervantes, F. D. J., Córdova-Esparza, D., Terven, J., Romero-González, J., González-Rodríguez, J., Ibarra-Corona, M., & Ramírez-Pedraza, P. (2025). Virtual Trainer for Learning Mexican Sign Language Using Video Similarity Analysis. Technologies, 13(12), 540. https://doi.org/10.3390/technologies13120540

Vancouver

Rivera-Cervantes FDJ, Córdova-Esparza D, Terven J, Romero-González J, González-Rodríguez J, Ibarra-Corona M, et al. Virtual Trainer for Learning Mexican Sign Language Using Video Similarity Analysis. Technologies. 2025;13(12):540. doi:10.3390/technologies13120540

BibTeX
@article{RiveraCervantes2025,
  author = {Rivera-Cervantes, Felipe de Jesús and Córdova-Esparza, Diana-Margarita and Terven, Juan and Romero-González, Julio-Alejandro and González-Rodríguez, Jaime-Rodrigo and Ibarra-Corona, Mauricio-Arturo and Ramírez-Pedraza, Pedro-Alfonso},
  title = {Virtual Trainer for Learning Mexican Sign Language Using Video Similarity Analysis},
  journal = {Technologies},
  year = {2025},
  volume = {13},
  number = {12},
  pages = {540},
  doi = {10.3390/technologies13120540}
}
Kostenlos starten →