EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Comprehensive Review of Deep Learning Approaches for Video-Based Sign Language Recognition: Datasets, Challenges and Insights

Ulmeken Berzhanova, Aigerim Yerimbetova, Marek Milosz, Bakzhan Sakenov, Dina Oralbekova, Elmira Daiyrbayeva, Daniyar Turgan

Multimodal Technologies and Interaction · 22.05.2026 · 10 (6) · 58

DOI: 10.3390/mti10060058 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Multimodal Technologies and Interaction, online erschienen am 22.05.2026. Verfasst von Ulmeken Berzhanova und 6 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 163 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Committee of Science of the Ministry of Science and Higher Education of the Republic of Kazakhstan.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study presents a comprehensive review of more than 100 research papers on sign language recognition (SLR) published between 2020 and 2026. The analysis focuses on deep learning approaches applied to video-based SLR, including spatiotemporal feature extraction, temporal modeling, attention mechanisms, motion-based representations, hybrid frameworks, transfer learning methods and other methods. Particular attention is given to how these methods model spatiotemporal dynamics and capture subtle gesture characteristics in sign language communication. The review highlights several recent developments, such as the introduction of specialized datasets, the emergence of real-time recognition systems, and the integration of multimodal fusion strategies. At the same time, persistent challenges remain, including data scarcity in low-resource sign languages, limited linguistic standardization of datasets, and insufficient model interpretability. The findings underline the importance of developing scalable and generalizable models capable of handling diverse datasets and user variability. The distinct contributions of this review are fourfold: (1) a comprehensive synthesis of over 100 studies published between 2020 and 2026, covering the full spectrum of deep learning architectures for video-based SLR; (2) a structured six-category taxonomy enabling systematic cross-architectural comparison; (3) a comprehensive focus on low-resource sign languages, which remain underrepresented in the existing literature; and (4) a critical analysis of the current benchmark landscape for low-resource sign languages, identifying key gaps and outlining strategic directions for future dataset development. These contributions are intended to guide further research toward more robust, inclusive, and universally applicable SLR systems.

Förderung

  • Committee of Science of the Ministry of Science and Higher Education of the Republic of Kazakhstan

Zitieren

APA

Berzhanova, U., Yerimbetova, A., Milosz, M., Sakenov, B., Oralbekova, D., Daiyrbayeva, E., & Turgan, D. (2026). A Comprehensive Review of Deep Learning Approaches for Video-Based Sign Language Recognition: Datasets, Challenges and Insights. Multimodal Technologies and Interaction, 10(6), 58. https://doi.org/10.3390/mti10060058

Vancouver

Berzhanova U, Yerimbetova A, Milosz M, Sakenov B, Oralbekova D, Daiyrbayeva E, et al. A Comprehensive Review of Deep Learning Approaches for Video-Based Sign Language Recognition: Datasets, Challenges and Insights. Multimodal Technologies and Interaction. 2026;10(6):58. doi:10.3390/mti10060058

BibTeX
@article{Berzhanova2026,
  author = {Berzhanova, Ulmeken and Yerimbetova, Aigerim and Milosz, Marek and Sakenov, Bakzhan and Oralbekova, Dina and Daiyrbayeva, Elmira and Turgan, Daniyar},
  title = {A Comprehensive Review of Deep Learning Approaches for Video-Based Sign Language Recognition: Datasets, Challenges and Insights},
  journal = {Multimodal Technologies and Interaction},
  year = {2026},
  volume = {10},
  number = {6},
  pages = {58},
  doi = {10.3390/mti10060058}
}
Kostenlos starten →