EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Application of neural networks ensemble method for the Kazakh sign language recognition

Yedilkhan Amirgaliyev, Aisulyu Ataniyazova, Zholdas Buribayev, Mukhtar Zhassuzak, Baydaulet Urmashev, Lyailya Cherikbayeva

Bulletin of Electrical Engineering and Informatics · 01.10.2024 · 13 (5) · 3275-3287

DOI: 10.11591/eei.v13i5.7803 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bulletin of Electrical Engineering and Informatics, online erschienen am 01.10.2024. Verfasst von Yedilkhan Amirgaliyev und 5 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sign languages are an extremely important means of communication in many cases, especially for deaf and hard of hearing people. But the same gesture can convey different meanings in different countries, so many different sign languages have been developed all over the world. In this study, a convolutional neural network (CNN) model was developed based on an ensemble method containing the ResNet-50 and VGG-19 architectures, which will be able to classify the Kazakh sign language (KSL) consisting of 42 Kazakh alphabet signs (classes). A proprietary data set of 57,708 images for 42 signs of the KSL has been formed. The ensemble model was compared with ResNet-50 and VGG-19 by evaluation metrics such as accuracy, precision, recall, f1-measure, and loss function. The recognition accuracy of the ensemble method reached 95.7%, exceeding the performance of ResNet-50 and VGG-19. The developed method was also tested on test data, where 35 out of 42 gestures were recognized completely correctly. The reliability of the proposed approach and the classification results obtained by using preprocessing methods and data augmentation techniques to expand the data set was confirmed by a computational experiment.

Zitieren

APA

Amirgaliyev, Y., Ataniyazova, A., Buribayev, Z., Zhassuzak, M., Urmashev, B., & Cherikbayeva, L. (2024). Application of neural networks ensemble method for the Kazakh sign language recognition. Bulletin of Electrical Engineering and Informatics, 13(5), 3275-3287. https://doi.org/10.11591/eei.v13i5.7803

Vancouver

Amirgaliyev Y, Ataniyazova A, Buribayev Z, Zhassuzak M, Urmashev B, Cherikbayeva L. Application of neural networks ensemble method for the Kazakh sign language recognition. Bulletin of Electrical Engineering and Informatics. 2024;13(5):3275-3287. doi:10.11591/eei.v13i5.7803

BibTeX
@article{Amirgaliyev2024,
  author = {Amirgaliyev, Yedilkhan and Ataniyazova, Aisulyu and Buribayev, Zholdas and Zhassuzak, Mukhtar and Urmashev, Baydaulet and Cherikbayeva, Lyailya},
  title = {Application of neural networks ensemble method for the Kazakh sign language recognition},
  journal = {Bulletin of Electrical Engineering and Informatics},
  year = {2024},
  volume = {13},
  number = {5},
  pages = {3275--3287},
  doi = {10.11591/eei.v13i5.7803}
}
Kostenlos starten →