EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multinational sign language recognition framework for inclusive multimedia communication

Alp Yüksel, Lavdie Rada

PeerJ Computer Science · 25.02.2026 · 12 · e3634

DOI: 10.7717/peerj-cs.3634 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 25.02.2026. Verfasst von Alp Yüksel und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advancements in multimedia technology have revolutionized digital device interactions, with sign language recognition emerging as a crucial tool for improving accessibility. This article introduces an innovative approach to integrating language-based sign language recognition into multimedia applications, enabling automatic recognition of gestures across various nationalities in dynamic sign language environments (video). Our research explores the potential of this technology to enhance accessibility and usability, particularly for individuals with hearing impairments, by facilitating intuitive and real-time control over video conferencing applications. We identify existing challenges in multimedia applications and propose a novel framework incorporating sign language recognition algorithms. Our approach involves developing a prototype multimedia application designed for fast communication in crowded environments and backgrounds. Feature extraction is performed using the Mediapipe Holistic framework, which captures hand-shoulder distances, finger angles, and finger usage. Gesture classification is achieved using the K-Nearest Neighbors (KNN) algorithm, effectively recognizing international sign language gestures. Additionally, for language and word prediction, we employ Convolutional Recurrent Neural Networks (CRNNs) enhanced by Long Short-Term Memory (LSTM) to process diverse linguistic contexts. Experimental results confirm the robustness of our approach, achieving 89% accuracy in multiclass gesture classification and exceeding 93% accuracy in word prediction across a large, diverse dataset collected from multiple sources and languages. To enhance practical applicability, we integrated our techniques into a custom video conferencing application built with Django. This application seamlessly incorporates our feature extraction and prediction models, offering an innovative, two-way communication platform with improved accessibility features.

Zitieren

APA

Yüksel, A., & Rada, L. (2026). Multinational sign language recognition framework for inclusive multimedia communication. PeerJ Computer Science, 12, e3634. https://doi.org/10.7717/peerj-cs.3634

Vancouver

Yüksel A, Rada L. Multinational sign language recognition framework for inclusive multimedia communication. PeerJ Computer Science. 2026;12:e3634. doi:10.7717/peerj-cs.3634

BibTeX
@article{Yksel2026,
  author = {Yüksel, Alp and Rada, Lavdie},
  title = {Multinational sign language recognition framework for inclusive multimedia communication},
  journal = {PeerJ Computer Science},
  year = {2026},
  volume = {12},
  pages = {e3634},
  doi = {10.7717/peerj-cs.3634}
}
Kostenlos starten →