EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The accuracy-bias trade-offs in AI text detection tools and their impact on fairness in scholarly publication

Ahmad R Pratama iD

PeerJ Computer Science · 23.06.2025 · 11 · e2953

DOI: 10.7717/peerj-cs.2953 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 23.06.2025. Verfasst von Ahmad R Pratama. Beteiligte Einrichtung: University Libraries, State University of New York at Stony Brook, Stony Brook, New York, United States. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 112 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Artificial intelligence (AI) text detection tools are considered a means of preserving the integrity of scholarly publication by identifying whether a text is written by humans or generated by AI. This study evaluates three popular tools (GPTZero, ZeroGPT, and DetectGPT) through two experiments: first, distinguishing human-written abstracts from those generated by ChatGPT o1 and Gemini 2.0 Pro Experimental; second, evaluating AI-assisted abstracts where the original text has been enhanced by these large language models (LLMs) to improve readability. Results reveal notable trade-offs in accuracy and bias, disproportionately affecting non-native speakers and certain disciplines. This study highlights the limitations of detection-focused approaches and advocates a shift toward ethical, responsible, and transparent use of LLMs in scholarly publication.

Schlagwörter

Stichwörter der Autor:innen

AI text detection toolsAccuracy-bias trade-offChatGPTDetectGPTFairness in scholarly publicationGPTZeroGeminiLarge language models (LLMs)Non-native authorsZeroGPT

Autor:innen und Institutionen

  • University Libraries, State University of New York at Stony Brook, Stony Brook, New York, United States.

ORCID-Profile: Ahmad R Pratama

Zitieren

APA

Pratama, A. R. (2025). The accuracy-bias trade-offs in AI text detection tools and their impact on fairness in scholarly publication. PeerJ Computer Science, 11, e2953. https://doi.org/10.7717/peerj-cs.2953

Vancouver

Pratama AR. The accuracy-bias trade-offs in AI text detection tools and their impact on fairness in scholarly publication. PeerJ Computer Science. 2025;11:e2953. doi:10.7717/peerj-cs.2953

BibTeX
@article{Pratama2025,
  author = {Pratama, Ahmad R},
  title = {The accuracy-bias trade-offs in AI text detection tools and their impact on fairness in scholarly publication},
  journal = {PeerJ Computer Science},
  year = {2025},
  volume = {11},
  pages = {e2953},
  doi = {10.7717/peerj-cs.2953}
}
Kostenlos starten →