Real-Time Norwegian Sign Language Recognition Using MediaPipe and LSTM
Multimodal Technologies and Interaction · 03.03.2025 · 9 (3) · 23
DOI: 10.3390/mti9030023 ↗Kurz gefasst
Fachartikel in der Zeitschrift Multimodal Technologies and Interaction, online erschienen am 03.03.2025. Verfasst von Md. Zia Uddin und 2 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Stiftelsen Dam.
Abstract (Originalsprache)
The application of machine learning models for sign language recognition (SLR) is a well-researched topic. However, many existing SLR systems focus on widely used sign languages, e.g., American Sign Language, leaving other underrepresented sign languages such as Norwegian Sign Language (NSL) relatively underexplored. This work presents a preliminary system for recognizing NSL gestures, focusing on numbers 0 to 10. Mediapipe is used for feature extraction and Long Short-Term Memory (LSTM) networks for temporal modeling. This system achieves a testing accuracy of 95%, aligning with existing benchmarks and demonstrating its robustness to variations in signing styles, orientations, and speeds. While challenges such as data imbalance and misclassification of similar gestures (e.g., Signs 3 and 8) were observed, the results underscore the potential of our proposed approach. Future iterations of the system will prioritize expanding the dataset by including additional gestures and environmental variations as well as integrating additional modalities.
Förderung
- Stiftelsen Dam
Zitieren
APA
Uddin, M. Z., Boletsis, C., & Rudshavn, P. (2025). Real-Time Norwegian Sign Language Recognition Using MediaPipe and LSTM. Multimodal Technologies and Interaction, 9(3), 23. https://doi.org/10.3390/mti9030023
Vancouver
Uddin MZ, Boletsis C, Rudshavn P. Real-Time Norwegian Sign Language Recognition Using MediaPipe and LSTM. Multimodal Technologies and Interaction. 2025;9(3):23. doi:10.3390/mti9030023
BibTeX
@article{Uddin2025,
author = {Uddin, Md. Zia and Boletsis, Costas and Rudshavn, Pål},
title = {Real-Time Norwegian Sign Language Recognition Using MediaPipe and LSTM},
journal = {Multimodal Technologies and Interaction},
year = {2025},
volume = {9},
number = {3},
pages = {23},
doi = {10.3390/mti9030023}
}
EUVIMED