Efhamni: A Deep Learning-Based Saudi Sign Language Recognition Application
Sensors · 2024
DOI: 10.3390/s24103112 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2024. Verfasst von Lama Al Khuzayem und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia. Hauptthemen laut MEDLINE: Sign Language, Deep Learning. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Deaf and hard-of-hearing people mainly communicate using sign language, which is a set of signs made using hand gestures combined with facial expressions to make meaningful and complete sentences. The problem that faces deaf and hard-of-hearing people is the lack of automatic tools that translate sign languages into written or spoken text, which has led to a communication gap between them and their communities. Most state-of-the-art vision-based sign language recognition approaches focus on translating non-Arabic sign languages, with few targeting the Arabic Sign Language (ArSL) and even fewer targeting the Saudi Sign Language (SSL). This paper proposes a mobile application that helps deaf and hard-of-hearing people in Saudi Arabia to communicate efficiently with their communities. The prototype is an Android-based mobile application that applies deep learning techniques to translate isolated SSL to text and audio and includes unique features that are not available in other related applications targeting ArSL. The proposed approach, when evaluated on a comprehensive dataset, has demonstrated its effectiveness by outperforming several state-of-the-art approaches and producing results that are comparable to these approaches. Moreover, testing the prototype on several deaf and hard-of-hearing users, in addition to hearing users, proved its usefulness. In the future, we aim to improve the accuracy of the model and enrich the application with more features.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer Science, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia.
ORCID-Profile: Safia Aljahdali, Ohoud Alzamzami
Zitieren
APA
Al Khuzayem, L., Shafi, S., Aljahdali, S., Alkhamesie, R., & Alzamzami, O. (2024). Efhamni: A Deep Learning-Based Saudi Sign Language Recognition Application. Sensors. https://doi.org/10.3390/s24103112
Vancouver
Al Khuzayem L, Shafi S, Aljahdali S, Alkhamesie R, Alzamzami O. Efhamni: A Deep Learning-Based Saudi Sign Language Recognition Application. Sensors. 2024. doi:10.3390/s24103112
BibTeX
@article{AlKhuzayem2024,
author = {Al Khuzayem, Lama and Shafi, Suha and Aljahdali, Safia and Alkhamesie, Rawan and Alzamzami, Ohoud},
title = {Efhamni: A Deep Learning-Based Saudi Sign Language Recognition Application},
journal = {Sensors},
year = {2024},
doi = {10.3390/s24103112}
}
EUVIMED