Translation Performance from the User’s Perspective of Large Language Models and Neural Machine Translation Systems
Information · 19.10.2023 · 14 (10) · 574
DOI: 10.3390/info14100574 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information, online erschienen am 19.10.2023. Verfasst von Jungha Son und 1 weiteren Autor:innen. Die Arbeit wurde bisher 57-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The rapid global expansion of ChatGPT, which plays a crucial role in interactive knowledge sharing and translation, underscores the importance of comparative performance assessments in artificial intelligence (AI) technology. This study concentrated on this crucial issue by exploring and contrasting the translation performances of large language models (LLMs) and neural machine translation (NMT) systems. For this aim, the APIs of Google Translate, Microsoft Translator, and OpenAI’s ChatGPT were utilized, leveraging parallel corpora from the Workshop on Machine Translation (WMT) 2018 and 2020 benchmarks. By applying recognized evaluation metrics such as BLEU, chrF, and TER, a comprehensive performance analysis across a variety of language pairs, translation directions, and reference token sizes was conducted. The findings reveal that while Google Translate and Microsoft Translator generally surpass ChatGPT in terms of their BLEU, chrF, and TER scores, ChatGPT exhibits superior performance in specific language pairs. Translations from non-English to English consistently yielded better results across all three systems compared with translations from English to non-English. Significantly, an improvement in translation system performance was observed as the token size increased, hinting at the potential benefits of training models on larger token sizes.
Zitieren
APA
Son, J., & Kim, B. (2023). Translation Performance from the User’s Perspective of Large Language Models and Neural Machine Translation Systems. Information, 14(10), 574. https://doi.org/10.3390/info14100574
Vancouver
Son J, Kim B. Translation Performance from the User’s Perspective of Large Language Models and Neural Machine Translation Systems. Information. 2023;14(10):574. doi:10.3390/info14100574
BibTeX
@article{Son2023,
author = {Son, Jungha and Kim, Boyoung},
title = {Translation Performance from the User’s Perspective of Large Language Models and Neural Machine Translation Systems},
journal = {Information},
year = {2023},
volume = {14},
number = {10},
pages = {574},
doi = {10.3390/info14100574}
}
EUVIMED