The Riddle of (Literary) Machine Translation Quality
Tradumàtica tecnologies de la traducció · 22.12.2023 · (21) · 129-159
DOI: 10.5565/rev/tradumatica.345 ↗Kurz gefasst
Fachartikel in der Zeitschrift Tradumàtica tecnologies de la traducció, online erschienen am 22.12.2023. Verfasst von Gys-Walt Van Egdom und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This study aims to gauge the reliability and validity of metrics and algorithms in evaluating the quality of machine translation in a literary context. Ten machine translated versions of a literary story, provided by four different MT engines over a period of three years, are compared applying two quantitative quality estimation scores (BLEU and a recently developed literariness algorithm). The comparative analysis provides an insight not only into the quality of stylistic and narratological features of machine translation, but also into more traditional quality criteria, such as accuracy and fluency. It is found that evaluations are not always in agreement and that they lack nuance. It is suggested that metrics and algorithms cover only parts of the notion of “quality”, and that a more fine-grained approach is needed if potential literary quality of machine translation is to be captured and possibly validated using those instruments.
Zitieren
APA
Egdom, G. V., Kosters, O., & Declercq, C. (2023). The Riddle of (Literary) Machine Translation Quality. Tradumàtica tecnologies de la traducció, 129-159. https://doi.org/10.5565/rev/tradumatica.345
Vancouver
Egdom GV, Kosters O, Declercq C. The Riddle of (Literary) Machine Translation Quality. Tradumàtica tecnologies de la traducció. 2023:129-159. doi:10.5565/rev/tradumatica.345
BibTeX
@article{Egdom2023,
author = {Egdom, Gys-Walt Van and Kosters, Onno and Declercq, Christophe},
title = {The Riddle of (Literary) Machine Translation Quality},
journal = {Tradumàtica tecnologies de la traducció},
year = {2023},
number = {21},
pages = {129--159},
doi = {10.5565/rev/tradumatica.345}
}
EUVIMED