Breaking the Silence: Convolutional Neural Networks for Sign Language Recognition in the Deaf Community
Sustainable Machine Intelligence Journal · 2022
DOI: 10.61185/smij.2022.7844 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sustainable Machine Intelligence Journal, 2022. Verfasst von Myvizhi Muthuswamy und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The deaf community faces communication barriers that hinder their interaction with the hearing world. This work aims to bridge the gap by enabling accurate recognition of Arabic sign language gestures. The proposed Convolutional Neural Networks (CNNs) architecture is designed to effectively capture the spatial features inherent in sign language gestures, thereby enhancing recognition accuracy. A distinctive aspect of our work involves the integration of a CNN architecture with a residual design, which effectively captures intricate spatial features inherent in sign language gestures, thereby enhancing recognition precision. The study leverages the ArSL2018 dataset, a comprehensive collection of grayscale sign language images with diverse lighting conditions and backgrounds. Our custom-built CNN model is trained on this dataset, utilizing a specialized learning rate scheduler for improved convergence. The experimental results showcase promising performance, demonstrating the potential of CNNs in sign language recognition. Furthermore, we present visualizations of the model's predictions using t-SNE, revealing the clustering patterns of different sign language gestures.
Zitieren
APA
Muthuswamy, M., Ali, A. M., & Abdelhafeez, A. (2022). Breaking the Silence: Convolutional Neural Networks for Sign Language Recognition in the Deaf Community. Sustainable Machine Intelligence Journal. https://doi.org/10.61185/smij.2022.7844
Vancouver
Muthuswamy M, Ali AM, Abdelhafeez A. Breaking the Silence: Convolutional Neural Networks for Sign Language Recognition in the Deaf Community. Sustainable Machine Intelligence Journal. 2022. doi:10.61185/smij.2022.7844
BibTeX
@article{Muthuswamy2022,
author = {Muthuswamy, Myvizhi and Ali, Ahmed M. and Abdelhafeez, Ahmed},
title = {Breaking the Silence: Convolutional Neural Networks for Sign Language Recognition in the Deaf Community},
journal = {Sustainable Machine Intelligence Journal},
year = {2022},
doi = {10.61185/smij.2022.7844}
}
EUVIMED