Machine translationese of large language models: Dependency triplets, text classification, and SHAP analysis
PLOS One · 09.01.2026 · 21 (1) · e0339769
DOI: 10.1371/journal.pone.0339769 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, online erschienen am 09.01.2026. Verfasst von Shukang Zhang und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Foreign Languages, East China Normal University, Shanghai, China. Hauptthemen laut MEDLINE: Natural Language Processing, Machine Learning. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Shanghai Philosophy and Social Science Planning Fund Project.
Abstract (Originalsprache)
This study addresses the challenge of distinguishing human translations from those generated by Large Language Models (LLMs) by utilizing dependency triplet features and evaluating 16 machine learning classifiers. Using 10-fold cross-validation, the SVM model achieves the highest mean F1-score of 93%, while all other classifiers consistently differentiate between human and machine translations. SHAP analysis helps identify key dependency features that distinguish human and machine translations, improving our understanding of how LLMs produce translationese. The findings provide practical insights for enhancing translation quality assessment and refining translation models across various languages and text genres, contributing to the advancement of natural language processing techniques. The dataset and implementation code of our study are available at: https://github.com/KiemaG5/LLM-translationese .
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Foreign Languages, East China Normal University, Shanghai, China.
ORCID-Profile: Shukang Zhang
Förderung
- Shanghai Philosophy and Social Science Planning Fund Project
Zitieren
APA
Zhang, S., & Zhao, C. (2026). Machine translationese of large language models: Dependency triplets, text classification, and SHAP analysis. PLOS One, 21(1), e0339769. https://doi.org/10.1371/journal.pone.0339769
Vancouver
Zhang S, Zhao C. Machine translationese of large language models: Dependency triplets, text classification, and SHAP analysis. PLOS One. 2026;21(1):e0339769. doi:10.1371/journal.pone.0339769
BibTeX
@article{Zhang2026,
author = {Zhang, Shukang and Zhao, Chaoyong},
title = {Machine translationese of large language models: Dependency triplets, text classification, and SHAP analysis},
journal = {PLOS One},
year = {2026},
volume = {21},
number = {1},
pages = {e0339769},
doi = {10.1371/journal.pone.0339769}
}
EUVIMED