EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Comparative Evaluation of Zero-Shot and Few-Shot Performance of Large Language Models in Low-Resource Language Machine Translation

Minhao Li, Xu Wang, Mingzhuo Yu

Journal of Global Engineering Review · 17.07.2025 · 3 (2) · 59-68

DOI: 10.66372/jger.v3i2.5 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Global Engineering Review, online erschienen am 17.07.2025. Verfasst von Minhao Li und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) have demonstrated remarkable translation capabilities for high-resource languages, yet their effectiveness on low-resource languages under varying prompting conditions remains insufficiently understood. This study presents a comparative evaluation of four LLMs—GPT-4, GPT-3.5-Turbo, LLaMA-2-70B, and BLOOM-176B—alongside NLLB-200-3.3B as a supervised baseline, across ten translation directions spanning four resource levels. Using the FLORES-200 devtest set as the primary benchmark and NTREX-128 for cross-validation, we assess zero-shot, one-shot, five-shot, and eight-shot configurations with BLEU, chrF++, and COMET-22 metrics. Our results reveal three principal findings. The few-shot advantage is most pronounced for low-resource languages, with GPT-4 achieving an average BLEU gain of 5.3 points when moving from zero-shot to five-shot on low-resource pairs. One-shot prompting consistently degrades performance below zero-shot baselines, with an average BLEU reduction of 1.4 points across low-resource directions. The supervised NLLB-200 baseline outperforms all LLMs in zero-shot on eight of ten directions, while five-shot GPT-4 narrows this gap to within 1.0 BLEU on mid-resource pairs. These findings provide empirical guidance for practitioners selecting prompting strategies for LLM-based translation in resource-constrained settings.

Zitieren

APA

Li, M., Wang, X., & Yu, M. (2025). Comparative Evaluation of Zero-Shot and Few-Shot Performance of Large Language Models in Low-Resource Language Machine Translation. Journal of Global Engineering Review, 3(2), 59-68. https://doi.org/10.66372/jger.v3i2.5

Vancouver

Li M, Wang X, Yu M. Comparative Evaluation of Zero-Shot and Few-Shot Performance of Large Language Models in Low-Resource Language Machine Translation. Journal of Global Engineering Review. 2025;3(2):59-68. doi:10.66372/jger.v3i2.5

BibTeX
@article{Li2025,
  author = {Li, Minhao and Wang, Xu and Yu, Mingzhuo},
  title = {Comparative Evaluation of Zero-Shot and Few-Shot Performance of Large Language Models in Low-Resource Language Machine Translation},
  journal = {Journal of Global Engineering Review},
  year = {2025},
  volume = {3},
  number = {2},
  pages = {59--68},
  doi = {10.66372/jger.v3i2.5}
}
Kostenlos starten →