The neural machine translation models for the low-resource Kazakh–English language pair
PeerJ Computer Science · 08.02.2023 · 9 · e1224
DOI: 10.7717/peerj-cs.1224 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 08.02.2023. Verfasst von Vladislav Karyukin und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Information Systems, Al-Farabi Kazakh National University, Almaty, Kazakhstan. Die Arbeit wurde bisher 32-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science and Higher Education of the Republic of Kazakhstan.
Abstract (Originalsprache)
The development of the machine translation field was driven by people’s need to communicate with each other globally by automatically translating words, sentences, and texts from one language into another. The neural machine translation approach has become one of the most significant in recent years. This approach requires large parallel corpora not available for low-resource languages, such as the Kazakh language, which makes it difficult to achieve the high performance of the neural machine translation models. This article explores the existing methods for dealing with low-resource languages by artificially increasing the size of the corpora and improving the performance of the Kazakh–English machine translation models. These methods are called forward translation, backward translation, and transfer learning. Then the Sequence-to-Sequence (recurrent neural network and bidirectional recurrent neural network) and Transformer neural machine translation architectures with their features and specifications are concerned for conducting experiments in training models on parallel corpora. The experimental part focuses on building translation models for the high-quality translation of formal social, political, and scientific texts with the synthetic parallel sentences from existing monolingual data in the Kazakh language using the forward translation approach and combining them with the parallel corpora parsed from the official government websites. The total corpora of 380,000 parallel Kazakh–English sentences are trained on the recurrent neural network, bidirectional recurrent neural network, and Transformer models of the OpenNMT framework. The quality of the trained model is evaluated with the BLEU, WER, and TER metrics. Moreover, the sample translations were also analyzed. The RNN and BRNN models showed a more precise translation than the Transformer model. The Byte-Pair Encoding tokenization technique showed better metrics scores and translation than the word tokenization technique. The Bidirectional recurrent neural network with the Byte-Pair Encoding technique showed the best performance with 0.49 BLEU, 0.51 WER, and 0.45 TER.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Information Systems, Al-Farabi Kazakh National University, Almaty, Kazakhstan.
- Institute of Information and Computational Technologies, Almaty, Kazakhstan.
ORCID-Profile: Diana Rakhimova
Förderung
- Ministry of Science and Higher Education of the Republic of Kazakhstan
Zitieren
APA
Karyukin, V., Rakhimova, D., Karibayeva, A., Turganbayeva, A., & Turarbek, A. (2023). The neural machine translation models for the low-resource Kazakh–English language pair. PeerJ Computer Science, 9, e1224. https://doi.org/10.7717/peerj-cs.1224
Vancouver
Karyukin V, Rakhimova D, Karibayeva A, Turganbayeva A, Turarbek A. The neural machine translation models for the low-resource Kazakh–English language pair. PeerJ Computer Science. 2023;9:e1224. doi:10.7717/peerj-cs.1224
BibTeX
@article{Karyukin2023,
author = {Karyukin, Vladislav and Rakhimova, Diana and Karibayeva, Aidana and Turganbayeva, Aliya and Turarbek, Asem},
title = {The neural machine translation models for the low-resource Kazakh–English language pair},
journal = {PeerJ Computer Science},
year = {2023},
volume = {9},
pages = {e1224},
doi = {10.7717/peerj-cs.1224}
}
EUVIMED