EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Breaking the Silence: Convolutional Neural Networks for Sign Language Recognition in the Deaf Community

Myvizhi Muthuswamy, Ahmed M. Ali, Ahmed Abdelhafeez

Sustainable Machine Intelligence Journal · 2022

DOI: 10.61185/smij.2022.7844 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sustainable Machine Intelligence Journal, 2022. Verfasst von Myvizhi Muthuswamy und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The deaf community faces communication barriers that hinder their interaction with the hearing world. This work aims to bridge the gap by enabling accurate recognition of Arabic sign language gestures. The proposed Convolutional Neural Networks (CNNs) architecture is designed to effectively capture the spatial features inherent in sign language gestures, thereby enhancing recognition accuracy. A distinctive aspect of our work involves the integration of a CNN architecture with a residual design, which effectively captures intricate spatial features inherent in sign language gestures, thereby enhancing recognition precision. The study leverages the ArSL2018 dataset, a comprehensive collection of grayscale sign language images with diverse lighting conditions and backgrounds. Our custom-built CNN model is trained on this dataset, utilizing a specialized learning rate scheduler for improved convergence. The experimental results showcase promising performance, demonstrating the potential of CNNs in sign language recognition. Furthermore, we present visualizations of the model's predictions using t-SNE, revealing the clustering patterns of different sign language gestures.

Zitieren

APA

Muthuswamy, M., Ali, A. M., & Abdelhafeez, A. (2022). Breaking the Silence: Convolutional Neural Networks for Sign Language Recognition in the Deaf Community. Sustainable Machine Intelligence Journal. https://doi.org/10.61185/smij.2022.7844

Vancouver

Muthuswamy M, Ali AM, Abdelhafeez A. Breaking the Silence: Convolutional Neural Networks for Sign Language Recognition in the Deaf Community. Sustainable Machine Intelligence Journal. 2022. doi:10.61185/smij.2022.7844

BibTeX
@article{Muthuswamy2022,
  author = {Muthuswamy, Myvizhi and Ali, Ahmed M. and Abdelhafeez, Ahmed},
  title = {Breaking the Silence: Convolutional Neural Networks for Sign Language Recognition in the Deaf Community},
  journal = {Sustainable Machine Intelligence Journal},
  year = {2022},
  doi = {10.61185/smij.2022.7844}
}
Kostenlos starten →