Implementation of Hand Movement Tracking for Real-Time Sign Language Translation
Journal of Innovation and Community Engagement · 28.05.2026 · 7 (2) · 173-187
DOI: 10.28932/ice.v7i2.12818 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Innovation and Community Engagement, online erschienen am 28.05.2026. Verfasst von Bernardus Anggodho Aryudhawan Hadi und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
This study developed a real-time American Sign Language (ASL) sign language identification and interpretation system based on deep learning. The system used two data sources: the ASL alphabet dataset for individual character recognition and the WLASL dataset for vocabulary recognition. The WLASL dataset was chosen as the benchmark for evaluating complex word gestures because it encompasses a wide range of users and extensive movement dynamics. Data processing involved extracting hand-gesture and body-posture markers using MediaPipe, followed by preprocessing and augmentation. Two learning architectures were implemented: a Feedforward Neural Network for alphabet classification and a BiLSTM integrated with an Attention Mechanism for vocabulary recognition. The system was evaluated using accuracy, precision, recall, F1 Score, and K-fold cross-validation. The results demonstrated promising performance: 99% accuracy for alphabet recognition and 78% for vocabulary recognition, with the Attention Mechanism contributing substantially to vocabulary recognition. The system operates in real time at 15-20 FPS and is efficient on mid-range devices, potentially becoming an inclusive communication alternative for the sign language community.
Zitieren
APA
Hadi, B. A. A., Handaya, W. B. T., & Suyoto, S. (2026). Implementation of Hand Movement Tracking for Real-Time Sign Language Translation. Journal of Innovation and Community Engagement, 7(2), 173-187. https://doi.org/10.28932/ice.v7i2.12818
Vancouver
Hadi BAA, Handaya WBT, Suyoto S. Implementation of Hand Movement Tracking for Real-Time Sign Language Translation. Journal of Innovation and Community Engagement. 2026;7(2):173-187. doi:10.28932/ice.v7i2.12818
BibTeX
@article{Hadi2026,
author = {Hadi, Bernardus Anggodho Aryudhawan and Handaya, Wilfridus Bambang Triadi and Suyoto, Suyoto},
title = {Implementation of Hand Movement Tracking for Real-Time Sign Language Translation},
journal = {Journal of Innovation and Community Engagement},
year = {2026},
volume = {7},
number = {2},
pages = {173--187},
doi = {10.28932/ice.v7i2.12818}
}
EUVIMED