EUVIMEDEUVIMED entdecken
Crossref

A Quantitative Evaluation of Neural Machine Translation Systems for English-Arabic Customs Legal Texts

Karam Damseh, Mozhgan Ghassemiazghandi

Arab World English Journal For Translation and Literary Studies · 15.05.2026 · 10 (2) · 43-58

DOI: 10.24093/awejtls/vol10no2.4 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Arab World English Journal For Translation and Literary Studies, online erschienen am 15.05.2026. Verfasst von Karam Damseh und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

While neural machine translation has transformed cross-lingual communication, its efficacy in specialized, high-stakes domains such as legal translation remains underexplored. This study addresses the central question of how different neural machine translation paradigms perform under the extreme syntactic and terminological constraints of customs law. The primary aim is to quantitatively evaluate three prominent systems—Google Translate, Systran, and Tarjama Translator—for translating English customs legal texts into Arabic. A 1,000-segment domain-specific sample drawn from the Revised Kyoto Convention was assessed using the cross-lingual, optimized metric for translation evaluation in reference-based mode. Because each source segment was evaluated across all three systems, statistical inference was conducted using a within-segment repeated-measures analysis with multiplicity-adjusted post hoc pairwise comparisons. Results reveal a clear performance hierarchy: Google Translate achieved the highest mean score (87.70), followed closely by Tarjama Translator (87.51), while Systran scored significantly lower (84.48). Stratified analysis by sentence length demonstrated consistent performance degradation across all systems as syntactic complexity increased, with Systran exhibiting the steepest decline on long sentences. These findings establish an operational baseline for tool selection and inform policymakers regarding neural machine translation readiness for cross-border customs communication. It is recommended that practitioners incorporate complexity-aware risk controls and human-in-the-loop verification when deploying these systems in legal workflows to mitigate the risks posed by structurally flawed translations.

Zitieren

APA

Damseh, K., & Ghassemiazghandi, M. (2026). A Quantitative Evaluation of Neural Machine Translation Systems for English-Arabic Customs Legal Texts. Arab World English Journal For Translation and Literary Studies, 10(2), 43-58. https://doi.org/10.24093/awejtls/vol10no2.4

Vancouver

Damseh K, Ghassemiazghandi M. A Quantitative Evaluation of Neural Machine Translation Systems for English-Arabic Customs Legal Texts. Arab World English Journal For Translation and Literary Studies. 2026;10(2):43-58. doi:10.24093/awejtls/vol10no2.4

BibTeX
@article{Damseh2026,
  author = {Damseh, Karam and Ghassemiazghandi, Mozhgan},
  title = {A Quantitative Evaluation of Neural Machine Translation Systems for English-Arabic Customs Legal Texts},
  journal = {Arab World English Journal For Translation and Literary Studies},
  year = {2026},
  volume = {10},
  number = {2},
  pages = {43--58},
  doi = {10.24093/awejtls/vol10no2.4}
}
Kostenlos starten →