EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Efhamni: A Deep Learning-Based Saudi Sign Language Recognition Application

Lama Al Khuzayem, Suha Shafi, Safia Aljahdali iD, Rawan Alkhamesie, Ohoud Alzamzami iD

Sensors · 2024

DOI: 10.3390/s24103112 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2024. Verfasst von Lama Al Khuzayem und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia. Hauptthemen laut MEDLINE: Sign Language, Deep Learning. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deaf and hard-of-hearing people mainly communicate using sign language, which is a set of signs made using hand gestures combined with facial expressions to make meaningful and complete sentences. The problem that faces deaf and hard-of-hearing people is the lack of automatic tools that translate sign languages into written or spoken text, which has led to a communication gap between them and their communities. Most state-of-the-art vision-based sign language recognition approaches focus on translating non-Arabic sign languages, with few targeting the Arabic Sign Language (ArSL) and even fewer targeting the Saudi Sign Language (SSL). This paper proposes a mobile application that helps deaf and hard-of-hearing people in Saudi Arabia to communicate efficiently with their communities. The prototype is an Android-based mobile application that applies deep learning techniques to translate isolated SSL to text and audio and includes unique features that are not available in other related applications targeting ArSL. The proposed approach, when evaluated on a comprehensive dataset, has demonstrated its effectiveness by outperforming several state-of-the-art approaches and producing results that are comparable to these approaches. Moreover, testing the prototype on several deaf and hard-of-hearing users, in addition to hearing users, proved its usefulness. In the future, we aim to improve the accuracy of the model and enrich the application with more features.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Sign LanguageDeep LearningHumansSaudi ArabiaMobile ApplicationsDeafnessPersons with Hearing Disabilities

Stichwörter der Autor:innen

CNNMobileNetdeep learningpose estimationsaudi sign languagesign language recognition

Autor:innen und Institutionen

  • Department of Computer Science, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia.

ORCID-Profile: Safia Aljahdali, Ohoud Alzamzami

Zitieren

APA

Al Khuzayem, L., Shafi, S., Aljahdali, S., Alkhamesie, R., & Alzamzami, O. (2024). Efhamni: A Deep Learning-Based Saudi Sign Language Recognition Application. Sensors. https://doi.org/10.3390/s24103112

Vancouver

Al Khuzayem L, Shafi S, Aljahdali S, Alkhamesie R, Alzamzami O. Efhamni: A Deep Learning-Based Saudi Sign Language Recognition Application. Sensors. 2024. doi:10.3390/s24103112

BibTeX
@article{AlKhuzayem2024,
  author = {Al Khuzayem, Lama and Shafi, Suha and Aljahdali, Safia and Alkhamesie, Rawan and Alzamzami, Ohoud},
  title = {Efhamni: A Deep Learning-Based Saudi Sign Language Recognition Application},
  journal = {Sensors},
  year = {2024},
  doi = {10.3390/s24103112}
}
Kostenlos starten →