EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Implementation of Hand Movement Tracking for Real-Time Sign Language Translation

Bernardus Anggodho Aryudhawan Hadi, Wilfridus Bambang Triadi Handaya, Suyoto Suyoto

Journal of Innovation and Community Engagement · 28.05.2026 · 7 (2) · 173-187

DOI: 10.28932/ice.v7i2.12818 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Innovation and Community Engagement, online erschienen am 28.05.2026. Verfasst von Bernardus Anggodho Aryudhawan Hadi und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study developed a real-time American Sign Language (ASL) sign language identification and interpretation system based on deep learning. The system used two data sources: the ASL alphabet dataset for individual character recognition and the WLASL dataset for vocabulary recognition. The WLASL dataset was chosen as the benchmark for evaluating complex word gestures because it encompasses a wide range of users and extensive movement dynamics. Data processing involved extracting hand-gesture and body-posture markers using MediaPipe, followed by preprocessing and augmentation. Two learning architectures were implemented: a Feedforward Neural Network for alphabet classification and a BiLSTM integrated with an Attention Mechanism for vocabulary recognition. The system was evaluated using accuracy, precision, recall, F1 Score, and K-fold cross-validation. The results demonstrated promising performance: 99% accuracy for alphabet recognition and 78% for vocabulary recognition, with the Attention Mechanism contributing substantially to vocabulary recognition. The system operates in real time at 15-20 FPS and is efficient on mid-range devices, potentially becoming an inclusive communication alternative for the sign language community.

Zitieren

APA

Hadi, B. A. A., Handaya, W. B. T., & Suyoto, S. (2026). Implementation of Hand Movement Tracking for Real-Time Sign Language Translation. Journal of Innovation and Community Engagement, 7(2), 173-187. https://doi.org/10.28932/ice.v7i2.12818

Vancouver

Hadi BAA, Handaya WBT, Suyoto S. Implementation of Hand Movement Tracking for Real-Time Sign Language Translation. Journal of Innovation and Community Engagement. 2026;7(2):173-187. doi:10.28932/ice.v7i2.12818

BibTeX
@article{Hadi2026,
  author = {Hadi, Bernardus Anggodho Aryudhawan and Handaya, Wilfridus Bambang Triadi and Suyoto, Suyoto},
  title = {Implementation of Hand Movement Tracking for Real-Time Sign Language Translation},
  journal = {Journal of Innovation and Community Engagement},
  year = {2026},
  volume = {7},
  number = {2},
  pages = {173--187},
  doi = {10.28932/ice.v7i2.12818}
}
Kostenlos starten →