EUVIMEDEUVIMED entdecken
Crossref

Distinguishing lexical deviation from semantic resilience in LLM-based round-trip translation

Kalin Kopanov, Tatiana Atanasova

New Trends in Computer Sciences · 17.08.2026 · 4 (1) · 60-92

DOI: 10.3846/ntcs.2026.26227 ↗

Kurz gefasst

Fachartikel in der Zeitschrift New Trends in Computer Sciences, online erschienen am 17.08.2026. Verfasst von Kalin Kopanov und 1 weiteren Autor:innen. Die Arbeit nennt 29 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Round-trip translation (RTT) is widely used for data augmentation and paraphrasing, yet its impact on meaning preservation remains poorly understood. We evaluate RTT systematically across two phases totaling 80,000 translation operations: 200 synthetic English passages are routed through single- and multi-hop pipelines spanning Bulgarian, Russian, and Chinese, translated by four systems ranging from a classical web translator (googletrans) to recent large language models (4o-mini, Claude Haiku 4.5, GPT-5-nano), with every passage undergoing ten RTT passes scored by BLEU, COMET-Kiwi, and xCOMET, joined by SBERT in the second phase. The results show that RTT outputs remain fluent while rapidly losing meaning: even the best configuration reaches only 0.646 xCOMET, and the four systems follow three distinct degradation regimes (front-loaded damage, continuous drift, and deterministic fixedpoint convergence). High surface overlap masks this loss, creating a surface fidelity trap, and genre-level analysis suggests that creative and news texts are most vulnerable. Sample-level inspection further reveals that xCOMET over-penalizes legitimate paraphrastic variation while under-penalizing domain-critical substitutions in legal text, exposing a mismatch between translation-oriented metrics and paraphrase evaluation. These findings argue against RTT in meaning-sensitive workflows and call for paraphrase-specific evaluation metrics.

Zitieren

APA

Kopanov, K., & Atanasova, T. (2026). Distinguishing lexical deviation from semantic resilience in LLM-based round-trip translation. New Trends in Computer Sciences, 4(1), 60-92. https://doi.org/10.3846/ntcs.2026.26227

Vancouver

Kopanov K, Atanasova T. Distinguishing lexical deviation from semantic resilience in LLM-based round-trip translation. New Trends in Computer Sciences. 2026;4(1):60-92. doi:10.3846/ntcs.2026.26227

BibTeX
@article{Kopanov2026,
  author = {Kopanov, Kalin and Atanasova, Tatiana},
  title = {Distinguishing lexical deviation from semantic resilience in LLM-based round-trip translation},
  journal = {New Trends in Computer Sciences},
  year = {2026},
  volume = {4},
  number = {1},
  pages = {60--92},
  doi = {10.3846/ntcs.2026.26227}
}
Kostenlos starten →