Application of neural networks ensemble method for the Kazakh sign language recognition
Bulletin of Electrical Engineering and Informatics · 01.10.2024 · 13 (5) · 3275-3287
DOI: 10.11591/eei.v13i5.7803 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bulletin of Electrical Engineering and Informatics, online erschienen am 01.10.2024. Verfasst von Yedilkhan Amirgaliyev und 5 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Sign languages are an extremely important means of communication in many cases, especially for deaf and hard of hearing people. But the same gesture can convey different meanings in different countries, so many different sign languages have been developed all over the world. In this study, a convolutional neural network (CNN) model was developed based on an ensemble method containing the ResNet-50 and VGG-19 architectures, which will be able to classify the Kazakh sign language (KSL) consisting of 42 Kazakh alphabet signs (classes). A proprietary data set of 57,708 images for 42 signs of the KSL has been formed. The ensemble model was compared with ResNet-50 and VGG-19 by evaluation metrics such as accuracy, precision, recall, f1-measure, and loss function. The recognition accuracy of the ensemble method reached 95.7%, exceeding the performance of ResNet-50 and VGG-19. The developed method was also tested on test data, where 35 out of 42 gestures were recognized completely correctly. The reliability of the proposed approach and the classification results obtained by using preprocessing methods and data augmentation techniques to expand the data set was confirmed by a computational experiment.
Zitieren
APA
Amirgaliyev, Y., Ataniyazova, A., Buribayev, Z., Zhassuzak, M., Urmashev, B., & Cherikbayeva, L. (2024). Application of neural networks ensemble method for the Kazakh sign language recognition. Bulletin of Electrical Engineering and Informatics, 13(5), 3275-3287. https://doi.org/10.11591/eei.v13i5.7803
Vancouver
Amirgaliyev Y, Ataniyazova A, Buribayev Z, Zhassuzak M, Urmashev B, Cherikbayeva L. Application of neural networks ensemble method for the Kazakh sign language recognition. Bulletin of Electrical Engineering and Informatics. 2024;13(5):3275-3287. doi:10.11591/eei.v13i5.7803
BibTeX
@article{Amirgaliyev2024,
author = {Amirgaliyev, Yedilkhan and Ataniyazova, Aisulyu and Buribayev, Zholdas and Zhassuzak, Mukhtar and Urmashev, Baydaulet and Cherikbayeva, Lyailya},
title = {Application of neural networks ensemble method for the Kazakh sign language recognition},
journal = {Bulletin of Electrical Engineering and Informatics},
year = {2024},
volume = {13},
number = {5},
pages = {3275--3287},
doi = {10.11591/eei.v13i5.7803}
}
EUVIMED