EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Machine translationese of large language models: Dependency triplets, text classification, and SHAP analysis

Shukang Zhang iD, Chaoyong Zhao

PLOS One · 09.01.2026 · 21 (1) · e0339769

DOI: 10.1371/journal.pone.0339769 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, online erschienen am 09.01.2026. Verfasst von Shukang Zhang und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Foreign Languages, East China Normal University, Shanghai, China. Hauptthemen laut MEDLINE: Natural Language Processing, Machine Learning. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shanghai Philosophy and Social Science Planning Fund Project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study addresses the challenge of distinguishing human translations from those generated by Large Language Models (LLMs) by utilizing dependency triplet features and evaluating 16 machine learning classifiers. Using 10-fold cross-validation, the SVM model achieves the highest mean F1-score of 93%, while all other classifiers consistently differentiate between human and machine translations. SHAP analysis helps identify key dependency features that distinguish human and machine translations, improving our understanding of how LLMs produce translationese. The findings provide practical insights for enhancing translation quality assessment and refining translation models across various languages and text genres, contributing to the advancement of natural language processing techniques. The dataset and implementation code of our study are available at: https://github.com/KiemaG5/LLM-translationese .

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Natural Language ProcessingMachine LearningLarge Language ModelsHumansClassification Algorithms

Autor:innen und Institutionen

  • School of Foreign Languages, East China Normal University, Shanghai, China.

ORCID-Profile: Shukang Zhang

Förderung

  • Shanghai Philosophy and Social Science Planning Fund Project

Zitieren

APA

Zhang, S., & Zhao, C. (2026). Machine translationese of large language models: Dependency triplets, text classification, and SHAP analysis. PLOS One, 21(1), e0339769. https://doi.org/10.1371/journal.pone.0339769

Vancouver

Zhang S, Zhao C. Machine translationese of large language models: Dependency triplets, text classification, and SHAP analysis. PLOS One. 2026;21(1):e0339769. doi:10.1371/journal.pone.0339769

BibTeX
@article{Zhang2026,
  author = {Zhang, Shukang and Zhao, Chaoyong},
  title = {Machine translationese of large language models: Dependency triplets, text classification, and SHAP analysis},
  journal = {PLOS One},
  year = {2026},
  volume = {21},
  number = {1},
  pages = {e0339769},
  doi = {10.1371/journal.pone.0339769}
}
Kostenlos starten →