EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Dual-Stream BiLSTM–Transformer Architecture for Real-Time Two-Handed Dynamic Sign Language Gesture Recognition

Enachi Andrei, Turcu Corneliu-Octavian, Culea George, Andrioaia Dragos-Alexandru, Ungureanu Andrei-Gabriel, Sghera Bogdan-Constantin

Applied Sciences · 18.03.2026 · 16 (6) · 2912

DOI: 10.3390/app16062912 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 18.03.2026. Verfasst von Enachi Andrei und 5 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Two-handed dynamic gesture recognition represents a fundamental component of sign language interpretation involving the modeling of temporal dependencies and inter-hand coordination. In this task, a major challenge is modeling asymmetric motion patterns, as well as bidirectional and long-range temporal dependencies. Most existing frameworks rely on early fusion strategies that merge joints, keypoints or landmarks from both hands in early processing stages, primarily to reduce model complexity and enforce a unified representation. In this work, a novel dual-stream BiLSTM–Transformer model architecture is proposed for two-handed dynamic sign language recognition, where parallel encoders process the trajectories of each hand independently. To capture spatial and temporal dependencies for each hand, an attention-based cross-hand fusion mechanism is employed, with hand landmarks extracted by the MediaPipe Hands framework as a preprocessing step to enable real-time CPU-based inference. Experimental evaluation conducted on custom Romanian Sign Language dynamic gesture datasets indicates that the proposed dual-stream-based system outperforms single-handed baselines, achieving improvements in high recognition accuracy for asymmetric gestures and consistent performance gains for synchronized two-handed gestures. The proposed architecture represents an efficient and lightweight solution suitable for real-time sign language recognition and interpretation.

Zitieren

APA

Andrei, E., Corneliu-Octavian, T., George, C., Dragos-Alexandru, A., Andrei-Gabriel, U., & Bogdan-Constantin, S. (2026). Dual-Stream BiLSTM–Transformer Architecture for Real-Time Two-Handed Dynamic Sign Language Gesture Recognition. Applied Sciences, 16(6), 2912. https://doi.org/10.3390/app16062912

Vancouver

Andrei E, Corneliu-Octavian T, George C, Dragos-Alexandru A, Andrei-Gabriel U, Bogdan-Constantin S. Dual-Stream BiLSTM–Transformer Architecture for Real-Time Two-Handed Dynamic Sign Language Gesture Recognition. Applied Sciences. 2026;16(6):2912. doi:10.3390/app16062912

BibTeX
@article{Andrei2026,
  author = {Andrei, Enachi and Corneliu-Octavian, Turcu and George, Culea and Dragos-Alexandru, Andrioaia and Andrei-Gabriel, Ungureanu and Bogdan-Constantin, Sghera},
  title = {Dual-Stream BiLSTM–Transformer Architecture for Real-Time Two-Handed Dynamic Sign Language Gesture Recognition},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {6},
  pages = {2912},
  doi = {10.3390/app16062912}
}
Kostenlos starten →