EUVIMEDEUVIMED entdecken
Crossref

Improving machine translation accuracy for underrepresented languages in linguistic research using transformer models

Yuanyuan Liu

Journal of Computational Methods in Sciences and Engineering · 2025-09 · 25 (5) · 4523-4538

DOI: 10.1177/14727978251337995 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computational Methods in Sciences and Engineering, online erschienen am 03.05.2025. Verfasst von Yuanyuan Liu. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 26 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Machine translation (MT) for underrepresented languages, such as Xhosa, presents significant challenges due to limited linguistic resources and the complex nature of these languages. This research proposes a novel approach to improve MT accuracy for Xhosa-to-English translation using Adaptive Gradient Boosted Bidirectional Encoder Representations from Transformers (AdaGrad-BBERT). This method combines the powerful capabilities of BERT with adaptive gradient boosting, enhancing contextual understanding and overall translation accuracy. The system integrates a series of preprocessing steps to optimize model performance. Initially, the dataset undergoes text cleaning, including the removal of noise, normalization of punctuation, and correction of spelling inconsistencies. Tokenization uses BERT’s word-piece model, effectively handling rare and out-of-vocabulary words. Part-of-speech tagging and dependency parsing are applied to capture syntactic relationships specific to Xhosa, which has distinct grammatical structures compared to English. Pre-trained BERT embeddings are employed to generate rich, context-sensitive representations of Xhosa words, ensuring more accurate translations. The encoder-decoder architecture with an attention mechanism is fine-tuned using the AdaGrad-BBERT optimization technique. Translation quality is evaluated using the BLEU score, and model performance is assessed over multiple training epochs. Simulations are conducted using the TensorFlow framework to train and evaluate the model on the Xhosa-English dataset, with results demonstrating significant improvements in translation accuracy, the BLUE score increased 0.896. The proposed system highlights the potential of AdaGrad-BBERT in bridging the gap in MT for underrepresented languages, offering a scalable solution for enhancing MT. This solution holds promising applications in education, cross-cultural communication, and digital inclusion.

Zitieren

APA

Liu, Y. (2025). Improving machine translation accuracy for underrepresented languages in linguistic research using transformer models. Journal of Computational Methods in Sciences and Engineering, 25(5), 4523-4538. https://doi.org/10.1177/14727978251337995

Vancouver

Liu Y. Improving machine translation accuracy for underrepresented languages in linguistic research using transformer models. Journal of Computational Methods in Sciences and Engineering. 2025;25(5):4523-4538. doi:10.1177/14727978251337995

BibTeX
@article{Liu2025,
  author = {Liu, Yuanyuan},
  title = {Improving machine translation accuracy for underrepresented languages in linguistic research using transformer models},
  journal = {Journal of Computational Methods in Sciences and Engineering},
  year = {2025},
  volume = {25},
  number = {5},
  pages = {4523--4538},
  doi = {10.1177/14727978251337995}
}
Kostenlos starten →