The accuracy-bias trade-offs in AI text detection tools and their impact on fairness in scholarly publication
PeerJ Computer Science · 23.06.2025 · 11 · e2953
DOI: 10.7717/peerj-cs.2953 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 23.06.2025. Verfasst von Ahmad R Pratama. Beteiligte Einrichtung: University Libraries, State University of New York at Stony Brook, Stony Brook, New York, United States. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 112 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Artificial intelligence (AI) text detection tools are considered a means of preserving the integrity of scholarly publication by identifying whether a text is written by humans or generated by AI. This study evaluates three popular tools (GPTZero, ZeroGPT, and DetectGPT) through two experiments: first, distinguishing human-written abstracts from those generated by ChatGPT o1 and Gemini 2.0 Pro Experimental; second, evaluating AI-assisted abstracts where the original text has been enhanced by these large language models (LLMs) to improve readability. Results reveal notable trade-offs in accuracy and bias, disproportionately affecting non-native speakers and certain disciplines. This study highlights the limitations of detection-focused approaches and advocates a shift toward ethical, responsible, and transparent use of LLMs in scholarly publication.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- University Libraries, State University of New York at Stony Brook, Stony Brook, New York, United States.
ORCID-Profile: Ahmad R Pratama
Zitieren
APA
Pratama, A. R. (2025). The accuracy-bias trade-offs in AI text detection tools and their impact on fairness in scholarly publication. PeerJ Computer Science, 11, e2953. https://doi.org/10.7717/peerj-cs.2953
Vancouver
Pratama AR. The accuracy-bias trade-offs in AI text detection tools and their impact on fairness in scholarly publication. PeerJ Computer Science. 2025;11:e2953. doi:10.7717/peerj-cs.2953
BibTeX
@article{Pratama2025,
author = {Pratama, Ahmad R},
title = {The accuracy-bias trade-offs in AI text detection tools and their impact on fairness in scholarly publication},
journal = {PeerJ Computer Science},
year = {2025},
volume = {11},
pages = {e2953},
doi = {10.7717/peerj-cs.2953}
}
EUVIMED