EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Real-Time Arabic Sign Language Recognition Using a Hybrid Deep Learning Model

Talal H Noor iD, Ayman Noor iD, Ahmed F Alharbi, Ahmed Faisal, Rakan Alrashidi, Ahmed S Alsaedi, Ghada Alharbi, Tawfeeq Alsanoosy iD, Abdullah Alsaeedi iD

Sensors · 06.06.2024 · 24 (11) · 3683

DOI: 10.3390/s24113683 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 06.06.2024. Verfasst von Talal H Noor und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, College of Computer Science and Engineering, Taibah University, Madinah 42353, Saudi Arabia. Hauptthemen laut MEDLINE: Sign Language, Deep Learning, Neural Networks, Computer. Die Arbeit wurde bisher 70-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sign language is an essential means of communication for individuals with hearing disabilities. However, there is a significant shortage of sign language interpreters in some languages, especially in Saudi Arabia. This shortage results in a large proportion of the hearing-impaired population being deprived of services, especially in public places. This paper aims to address this gap in accessibility by leveraging technology to develop systems capable of recognizing Arabic Sign Language (ArSL) using deep learning techniques. In this paper, we propose a hybrid model to capture the spatio-temporal aspects of sign language (i.e., letters and words). The hybrid model consists of a Convolutional Neural Network (CNN) classifier to extract spatial features from sign language data and a Long Short-Term Memory (LSTM) classifier to extract spatial and temporal characteristics to handle sequential data (i.e., hand movements). To demonstrate the feasibility of our proposed hybrid model, we created a dataset of 20 different words, resulting in 4000 images for ArSL: 10 static gesture words and 500 videos for 10 dynamic gesture words. Our proposed hybrid model demonstrates promising performance, with the CNN and LSTM classifiers achieving accuracy rates of 94.40% and 82.70%, respectively. These results indicate that our approach can significantly enhance communication accessibility for the hearing-impaired community in Saudi Arabia. Thus, this paper represents a major step toward promoting inclusivity and improving the quality of life for the hearing impaired.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Sign LanguageDeep LearningNeural Networks, ComputerHumansSaudi ArabiaLanguageGestures

Stichwörter der Autor:innen

Arabic sign language recognitionCNNsLSTMdeep learningreal-time detection

Autor:innen und Institutionen

  • Department of Computer Science, College of Computer Science and Engineering, Taibah University, Madinah 42353, Saudi Arabia.

ORCID-Profile: Talal H Noor, Ayman Noor, Tawfeeq Alsanoosy, Abdullah Alsaeedi

Zitieren

APA

Noor, T. H., Noor, A., Alharbi, A. F., Faisal, A., Alrashidi, R., Alsaedi, A. S., Alharbi, G., Alsanoosy, T., & Alsaeedi, A. (2024). Real-Time Arabic Sign Language Recognition Using a Hybrid Deep Learning Model. Sensors, 24(11), 3683. https://doi.org/10.3390/s24113683

Vancouver

Noor TH, Noor A, Alharbi AF, Faisal A, Alrashidi R, Alsaedi AS, et al. Real-Time Arabic Sign Language Recognition Using a Hybrid Deep Learning Model. Sensors. 2024;24(11):3683. doi:10.3390/s24113683

BibTeX
@article{Noor2024,
  author = {Noor, Talal H and Noor, Ayman and Alharbi, Ahmed F and Faisal, Ahmed and Alrashidi, Rakan and Alsaedi, Ahmed S and Alharbi, Ghada and Alsanoosy, Tawfeeq and Alsaeedi, Abdullah},
  title = {Real-Time Arabic Sign Language Recognition Using a Hybrid Deep Learning Model},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {11},
  pages = {3683},
  doi = {10.3390/s24113683}
}
Kostenlos starten →