EUVIMEDOpdag EUVIMED
Crossref

Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM

Youssef Farhan, Zineb Haimer, Oumaima Lamaamar, Abdessalam Ait Madi

CommIT (Communication and Information Technology) Journal · 2026-09-03 · 363

DOI: 10.21512/commit.v20i2.14176 ↗

At a glance

Journal article in CommIT (Communication and Information Technology) Journal, published online on 2026-09-03. Written by Youssef Farhan and 3 co-authors. 40 references.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

The inability of the general population to understand sign language creates serious communication barriers for hearing-impaired individuals in critical situations such as healthcare emergencies, educational settings, and workplace environments. Addressing this gap requires effective and accurate automated recognition systems. This proposed research presents a real-time American Sign Language (ASL) recognition system for 24 dynamic signs that integrates the MediaPipe frame work with Long Short-Term Memory (LSTM) network. To enhance performance while reducing computational complexity, only the most relevant features are extracted from self-recorded dynamic sign videos: coordinates of 65 key hand and body landmarks, complemented by 41 engineered angle features between joint connections and 26 engineered distance features between specific landmark pairs, yielding a compact 285-feature representation per frame. As a result, LSTM network handles spatiotemporal sequence modeling across 25-frame sequences, effectively capturing the dynamic nature of sign language gestures. The proposed system achieves 98% test accuracy, with precision, recall, and F1-score of 98% across 720 test samples. It also successfully interprets all 24 dynamic signs in real-time testing scenarios using a standard webcam, including visually similar sign pairs such as “Good”/“Bad” and “Mother”/“Not”, demonstrating its practical applicability for assistive communication technologies. The research contribution lies in the systematic integration of MediaPipe Holistic with strategic feature engineering (combining landmark coordinates with computed angles and distances) and LSTM modeling to achieve efficient real-time dynamic sign recognition with reduced computational and data requirements.

Cite

APA

Farhan, Y., Haimer, Z., Lamaamar, O., & Madi, A. A. (2026). Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM. CommIT (Communication and Information Technology) Journal, 363. https://doi.org/10.21512/commit.v20i2.14176

Vancouver

Farhan Y, Haimer Z, Lamaamar O, Madi AA. Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM. CommIT (Communication and Information Technology) Journal. 2026:363. doi:10.21512/commit.v20i2.14176

BibTeX
@article{Farhan2026,
  author = {Farhan, Youssef and Haimer, Zineb and Lamaamar, Oumaima and Madi, Abdessalam Ait},
  title = {Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM},
  journal = {CommIT (Communication and Information Technology) Journal},
  year = {2026},
  pages = {363},
  doi = {10.21512/commit.v20i2.14176}
}
Start for free →