EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep Learning Technology to Recognize American Sign Language Alphabet

Bader Alsharif iD, Ali Salem Altaher iD, Ahmed Altaher iD, Mohammad Ilyas, Easa Alalwany iD

Sensors · 2023

DOI: 10.3390/s23187970 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Bader Alsharif und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical Engineering and Computer Science, Florida Atlantic University, 777 Glades Road, Boca Raton, FL 33431, USA. Hauptthemen laut MEDLINE: Sign Language, Deep Learning. Die Arbeit wurde bisher 64-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Historically, individuals with hearing impairments have faced neglect, lacking the necessary tools to facilitate effective communication. However, advancements in modern technology have paved the way for the development of various tools and software aimed at improving the quality of life for hearing-disabled individuals. This research paper presents a comprehensive study employing five distinct deep learning models to recognize hand gestures for the American Sign Language (ASL) alphabet. The primary objective of this study was to leverage contemporary technology to bridge the communication gap between hearing-impaired individuals and individuals with no hearing impairment. The models utilized in this research include AlexNet, ConvNeXt, EfficientNet, ResNet-50, and VisionTransformer were trained and tested using an extensive dataset comprising over 87,000 images of the ASL alphabet hand gestures. Numerous experiments were conducted, involving modifications to the architectural design parameters of the models to obtain maximum recognition accuracy. The experimental results of our study revealed that ResNet-50 achieved an exceptional accuracy rate of 99.98%, the highest among all models. EfficientNet attained an accuracy rate of 99.95%, ConvNeXt achieved 99.51% accuracy, AlexNet attained 99.50% accuracy, while VisionTransformer yielded the lowest accuracy of 88.59%.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Sign LanguageDeep LearningHumansUnited StatesQuality of LifeGesturesTechnology

Stichwörter der Autor:innen

AlexNetAmerican sign languageConvNeXtEfficientNetResNet-50VisionTransformerdeep learningimage-basedtransfer learning

Autor:innen und Institutionen

  • Department of Electrical Engineering and Computer Science, Florida Atlantic University, 777 Glades Road, Boca Raton, FL 33431, USA.
  • Department of Computer Science and Engineering, College of Telecommunication and Information, Technical and Vocational Training Corporation (TVTC), Riyadh 11564, Saudi Arabia.
  • Electronic Computer Center, Al-Nahrain University, Jadriya, Baghdad 64074, Iraq.
  • College of Computer Science and Engineering, Taibah University, Yanbu 46421, Saudi Arabia.

ORCID-Profile: Bader Alsharif, Ali Salem Altaher, Ahmed Altaher, Easa Alalwany

Zitieren

APA

Alsharif, B., Altaher, A. S., Altaher, A., Ilyas, M., & Alalwany, E. (2023). Deep Learning Technology to Recognize American Sign Language Alphabet. Sensors. https://doi.org/10.3390/s23187970

Vancouver

Alsharif B, Altaher AS, Altaher A, Ilyas M, Alalwany E. Deep Learning Technology to Recognize American Sign Language Alphabet. Sensors. 2023. doi:10.3390/s23187970

BibTeX
@article{Alsharif2023,
  author = {Alsharif, Bader and Altaher, Ali Salem and Altaher, Ahmed and Ilyas, Mohammad and Alalwany, Easa},
  title = {Deep Learning Technology to Recognize American Sign Language Alphabet},
  journal = {Sensors},
  year = {2023},
  doi = {10.3390/s23187970}
}
Kostenlos starten →