EUVIMEDEUVIMED entdecken
Crossref

Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM

Youssef Farhan, Zineb Haimer, Oumaima Lamaamar, Abdessalam Ait Madi

CommIT (Communication and Information Technology) Journal · 03.09.2026 · 363

DOI: 10.21512/commit.v20i2.14176 ↗

Kurz gefasst

Fachartikel in der Zeitschrift CommIT (Communication and Information Technology) Journal, online erschienen am 03.09.2026. Verfasst von Youssef Farhan und 3 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The inability of the general population to understand sign language creates serious communication barriers for hearing-impaired individuals in critical situations such as healthcare emergencies, educational settings, and workplace environments. Addressing this gap requires effective and accurate automated recognition systems. This proposed research presents a real-time American Sign Language (ASL) recognition system for 24 dynamic signs that integrates the MediaPipe frame work with Long Short-Term Memory (LSTM) network. To enhance performance while reducing computational complexity, only the most relevant features are extracted from self-recorded dynamic sign videos: coordinates of 65 key hand and body landmarks, complemented by 41 engineered angle features between joint connections and 26 engineered distance features between specific landmark pairs, yielding a compact 285-feature representation per frame. As a result, LSTM network handles spatiotemporal sequence modeling across 25-frame sequences, effectively capturing the dynamic nature of sign language gestures. The proposed system achieves 98% test accuracy, with precision, recall, and F1-score of 98% across 720 test samples. It also successfully interprets all 24 dynamic signs in real-time testing scenarios using a standard webcam, including visually similar sign pairs such as “Good”/“Bad” and “Mother”/“Not”, demonstrating its practical applicability for assistive communication technologies. The research contribution lies in the systematic integration of MediaPipe Holistic with strategic feature engineering (combining landmark coordinates with computed angles and distances) and LSTM modeling to achieve efficient real-time dynamic sign recognition with reduced computational and data requirements.

Zitieren

APA

Farhan, Y., Haimer, Z., Lamaamar, O., & Madi, A. A. (2026). Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM. CommIT (Communication and Information Technology) Journal, 363. https://doi.org/10.21512/commit.v20i2.14176

Vancouver

Farhan Y, Haimer Z, Lamaamar O, Madi AA. Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM. CommIT (Communication and Information Technology) Journal. 2026:363. doi:10.21512/commit.v20i2.14176

BibTeX
@article{Farhan2026,
  author = {Farhan, Youssef and Haimer, Zineb and Lamaamar, Oumaima and Madi, Abdessalam Ait},
  title = {Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM},
  journal = {CommIT (Communication and Information Technology) Journal},
  year = {2026},
  pages = {363},
  doi = {10.21512/commit.v20i2.14176}
}
Kostenlos starten →