Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM
CommIT (Communication and Information Technology) Journal · 2026-09-03 · 363
DOI: 10.21512/commit.v20i2.14176 ↗At a glance
Journal article in CommIT (Communication and Information Technology) Journal, published online on 2026-09-03. Written by Youssef Farhan and 3 co-authors. 40 references.
Abstract (original language)
The inability of the general population to understand sign language creates serious communication barriers for hearing-impaired individuals in critical situations such as healthcare emergencies, educational settings, and workplace environments. Addressing this gap requires effective and accurate automated recognition systems. This proposed research presents a real-time American Sign Language (ASL) recognition system for 24 dynamic signs that integrates the MediaPipe frame work with Long Short-Term Memory (LSTM) network. To enhance performance while reducing computational complexity, only the most relevant features are extracted from self-recorded dynamic sign videos: coordinates of 65 key hand and body landmarks, complemented by 41 engineered angle features between joint connections and 26 engineered distance features between specific landmark pairs, yielding a compact 285-feature representation per frame. As a result, LSTM network handles spatiotemporal sequence modeling across 25-frame sequences, effectively capturing the dynamic nature of sign language gestures. The proposed system achieves 98% test accuracy, with precision, recall, and F1-score of 98% across 720 test samples. It also successfully interprets all 24 dynamic signs in real-time testing scenarios using a standard webcam, including visually similar sign pairs such as “Good”/“Bad” and “Mother”/“Not”, demonstrating its practical applicability for assistive communication technologies. The research contribution lies in the systematic integration of MediaPipe Holistic with strategic feature engineering (combining landmark coordinates with computed angles and distances) and LSTM modeling to achieve efficient real-time dynamic sign recognition with reduced computational and data requirements.
Cite
APA
Farhan, Y., Haimer, Z., Lamaamar, O., & Madi, A. A. (2026). Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM. CommIT (Communication and Information Technology) Journal, 363. https://doi.org/10.21512/commit.v20i2.14176
Vancouver
Farhan Y, Haimer Z, Lamaamar O, Madi AA. Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM. CommIT (Communication and Information Technology) Journal. 2026:363. doi:10.21512/commit.v20i2.14176
BibTeX
@article{Farhan2026,
author = {Farhan, Youssef and Haimer, Zineb and Lamaamar, Oumaima and Madi, Abdessalam Ait},
title = {Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM},
journal = {CommIT (Communication and Information Technology) Journal},
year = {2026},
pages = {363},
doi = {10.21512/commit.v20i2.14176}
}
EUVIMED