Dual-Stream BiLSTM–Transformer Architecture for Real-Time Two-Handed Dynamic Sign Language Gesture Recognition
Applied Sciences · 18.03.2026 · 16 (6) · 2912
DOI: 10.3390/app16062912 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 18.03.2026. Verfasst von Enachi Andrei und 5 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Two-handed dynamic gesture recognition represents a fundamental component of sign language interpretation involving the modeling of temporal dependencies and inter-hand coordination. In this task, a major challenge is modeling asymmetric motion patterns, as well as bidirectional and long-range temporal dependencies. Most existing frameworks rely on early fusion strategies that merge joints, keypoints or landmarks from both hands in early processing stages, primarily to reduce model complexity and enforce a unified representation. In this work, a novel dual-stream BiLSTM–Transformer model architecture is proposed for two-handed dynamic sign language recognition, where parallel encoders process the trajectories of each hand independently. To capture spatial and temporal dependencies for each hand, an attention-based cross-hand fusion mechanism is employed, with hand landmarks extracted by the MediaPipe Hands framework as a preprocessing step to enable real-time CPU-based inference. Experimental evaluation conducted on custom Romanian Sign Language dynamic gesture datasets indicates that the proposed dual-stream-based system outperforms single-handed baselines, achieving improvements in high recognition accuracy for asymmetric gestures and consistent performance gains for synchronized two-handed gestures. The proposed architecture represents an efficient and lightweight solution suitable for real-time sign language recognition and interpretation.
Zitieren
APA
Andrei, E., Corneliu-Octavian, T., George, C., Dragos-Alexandru, A., Andrei-Gabriel, U., & Bogdan-Constantin, S. (2026). Dual-Stream BiLSTM–Transformer Architecture for Real-Time Two-Handed Dynamic Sign Language Gesture Recognition. Applied Sciences, 16(6), 2912. https://doi.org/10.3390/app16062912
Vancouver
Andrei E, Corneliu-Octavian T, George C, Dragos-Alexandru A, Andrei-Gabriel U, Bogdan-Constantin S. Dual-Stream BiLSTM–Transformer Architecture for Real-Time Two-Handed Dynamic Sign Language Gesture Recognition. Applied Sciences. 2026;16(6):2912. doi:10.3390/app16062912
BibTeX
@article{Andrei2026,
author = {Andrei, Enachi and Corneliu-Octavian, Turcu and George, Culea and Dragos-Alexandru, Andrioaia and Andrei-Gabriel, Ungureanu and Bogdan-Constantin, Sghera},
title = {Dual-Stream BiLSTM–Transformer Architecture for Real-Time Two-Handed Dynamic Sign Language Gesture Recognition},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {6},
pages = {2912},
doi = {10.3390/app16062912}
}
EUVIMED