EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Benchmarking Transformer Models for Low-Resource Language Translation: A Case Study on the Tegalan-Indonesian Language Pair

Dwi Intan Af'idah, Sharfina Febbi Handayani, Ratri Wikaningtyas

Engineering, Technology & Applied Science Research · 04.04.2026 · 16 (2) · 32869-32875

DOI: 10.48084/etasr.16348 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Engineering, Technology & Applied Science Research, online erschienen am 04.04.2026. Verfasst von Dwi Intan Af'idah und 2 weiteren Autor:innen. Die Arbeit nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study investigates how well Transformer models can translate a low-resource local language, Tegalan, to Indonesian. Three Transformer-based models, mBART-50, mT5, and NLLB-200, were tested using a new parallel Tegalan-Indonesian dataset, collected from everyday conversations and online news texts. The translations were manually reviewed by native speakers and cultural experts. The preprocessing steps included case folding, spelling normalization, and subword tokenization to ensure consistency and handle dialect differences. Each model was fine-tuned under controlled conditions, with manual adjustment of hyperparameters. BLEU, METEOR, and TER were used to evaluate the models, offering insight into word-level accuracy, semantic alignment, and the required number of edits. The results show that NLLB-200 achieved the highest performance, with BLEU scores of 85.51, METEOR scores of 76.91, and TER scores of 17.73, clearly exceeding both mBART-50 and mT5. A qualitative review of the output indicated that NLLB-200 generated more natural and contextually appropriate translations. The results suggest that Transformer models can be a practical option for translation in low-resource environments and may also contribute to ongoing efforts to document and maintain regional languages. Further work is planned to enlarge the dataset and examine the extent to which semi-supervised techniques might strengthen both accuracy and overall model robustness.

Zitieren

APA

Af'idah, D. I., Handayani, S. F., & Wikaningtyas, R. (2026). Benchmarking Transformer Models for Low-Resource Language Translation: A Case Study on the Tegalan-Indonesian Language Pair. Engineering, Technology & Applied Science Research, 16(2), 32869-32875. https://doi.org/10.48084/etasr.16348

Vancouver

Af'idah DI, Handayani SF, Wikaningtyas R. Benchmarking Transformer Models for Low-Resource Language Translation: A Case Study on the Tegalan-Indonesian Language Pair. Engineering, Technology & Applied Science Research. 2026;16(2):32869-32875. doi:10.48084/etasr.16348

BibTeX
@article{Afidah2026,
  author = {Af'idah, Dwi Intan and Handayani, Sharfina Febbi and Wikaningtyas, Ratri},
  title = {Benchmarking Transformer Models for Low-Resource Language Translation: A Case Study on the Tegalan-Indonesian Language Pair},
  journal = {Engineering, Technology & Applied Science Research},
  year = {2026},
  volume = {16},
  number = {2},
  pages = {32869--32875},
  doi = {10.48084/etasr.16348}
}
Kostenlos starten →