Deep Learning Technology to Recognize American Sign Language Alphabet
Sensors · 2023
DOI: 10.3390/s23187970 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Bader Alsharif und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical Engineering and Computer Science, Florida Atlantic University, 777 Glades Road, Boca Raton, FL 33431, USA. Hauptthemen laut MEDLINE: Sign Language, Deep Learning. Die Arbeit wurde bisher 64-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Historically, individuals with hearing impairments have faced neglect, lacking the necessary tools to facilitate effective communication. However, advancements in modern technology have paved the way for the development of various tools and software aimed at improving the quality of life for hearing-disabled individuals. This research paper presents a comprehensive study employing five distinct deep learning models to recognize hand gestures for the American Sign Language (ASL) alphabet. The primary objective of this study was to leverage contemporary technology to bridge the communication gap between hearing-impaired individuals and individuals with no hearing impairment. The models utilized in this research include AlexNet, ConvNeXt, EfficientNet, ResNet-50, and VisionTransformer were trained and tested using an extensive dataset comprising over 87,000 images of the ASL alphabet hand gestures. Numerous experiments were conducted, involving modifications to the architectural design parameters of the models to obtain maximum recognition accuracy. The experimental results of our study revealed that ResNet-50 achieved an exceptional accuracy rate of 99.98%, the highest among all models. EfficientNet attained an accuracy rate of 99.95%, ConvNeXt achieved 99.51% accuracy, AlexNet attained 99.50% accuracy, while VisionTransformer yielded the lowest accuracy of 88.59%.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electrical Engineering and Computer Science, Florida Atlantic University, 777 Glades Road, Boca Raton, FL 33431, USA.
- Department of Computer Science and Engineering, College of Telecommunication and Information, Technical and Vocational Training Corporation (TVTC), Riyadh 11564, Saudi Arabia.
- Electronic Computer Center, Al-Nahrain University, Jadriya, Baghdad 64074, Iraq.
- College of Computer Science and Engineering, Taibah University, Yanbu 46421, Saudi Arabia.
ORCID-Profile: Bader Alsharif, Ali Salem Altaher, Ahmed Altaher, Easa Alalwany
Zitieren
APA
Alsharif, B., Altaher, A. S., Altaher, A., Ilyas, M., & Alalwany, E. (2023). Deep Learning Technology to Recognize American Sign Language Alphabet. Sensors. https://doi.org/10.3390/s23187970
Vancouver
Alsharif B, Altaher AS, Altaher A, Ilyas M, Alalwany E. Deep Learning Technology to Recognize American Sign Language Alphabet. Sensors. 2023. doi:10.3390/s23187970
BibTeX
@article{Alsharif2023,
author = {Alsharif, Bader and Altaher, Ali Salem and Altaher, Ahmed and Ilyas, Mohammad and Alalwany, Easa},
title = {Deep Learning Technology to Recognize American Sign Language Alphabet},
journal = {Sensors},
year = {2023},
doi = {10.3390/s23187970}
}
EUVIMED