Benchmarking Transformer Models for Low-Resource Language Translation: A Case Study on the Tegalan-Indonesian Language Pair
Engineering, Technology & Applied Science Research · 04.04.2026 · 16 (2) · 32869-32875
DOI: 10.48084/etasr.16348 ↗Kurz gefasst
Fachartikel in der Zeitschrift Engineering, Technology & Applied Science Research, online erschienen am 04.04.2026. Verfasst von Dwi Intan Af'idah und 2 weiteren Autor:innen. Die Arbeit nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This study investigates how well Transformer models can translate a low-resource local language, Tegalan, to Indonesian. Three Transformer-based models, mBART-50, mT5, and NLLB-200, were tested using a new parallel Tegalan-Indonesian dataset, collected from everyday conversations and online news texts. The translations were manually reviewed by native speakers and cultural experts. The preprocessing steps included case folding, spelling normalization, and subword tokenization to ensure consistency and handle dialect differences. Each model was fine-tuned under controlled conditions, with manual adjustment of hyperparameters. BLEU, METEOR, and TER were used to evaluate the models, offering insight into word-level accuracy, semantic alignment, and the required number of edits. The results show that NLLB-200 achieved the highest performance, with BLEU scores of 85.51, METEOR scores of 76.91, and TER scores of 17.73, clearly exceeding both mBART-50 and mT5. A qualitative review of the output indicated that NLLB-200 generated more natural and contextually appropriate translations. The results suggest that Transformer models can be a practical option for translation in low-resource environments and may also contribute to ongoing efforts to document and maintain regional languages. Further work is planned to enlarge the dataset and examine the extent to which semi-supervised techniques might strengthen both accuracy and overall model robustness.
Zitieren
APA
Af'idah, D. I., Handayani, S. F., & Wikaningtyas, R. (2026). Benchmarking Transformer Models for Low-Resource Language Translation: A Case Study on the Tegalan-Indonesian Language Pair. Engineering, Technology & Applied Science Research, 16(2), 32869-32875. https://doi.org/10.48084/etasr.16348
Vancouver
Af'idah DI, Handayani SF, Wikaningtyas R. Benchmarking Transformer Models for Low-Resource Language Translation: A Case Study on the Tegalan-Indonesian Language Pair. Engineering, Technology & Applied Science Research. 2026;16(2):32869-32875. doi:10.48084/etasr.16348
BibTeX
@article{Afidah2026,
author = {Af'idah, Dwi Intan and Handayani, Sharfina Febbi and Wikaningtyas, Ratri},
title = {Benchmarking Transformer Models for Low-Resource Language Translation: A Case Study on the Tegalan-Indonesian Language Pair},
journal = {Engineering, Technology & Applied Science Research},
year = {2026},
volume = {16},
number = {2},
pages = {32869--32875},
doi = {10.48084/etasr.16348}
}
EUVIMED