An Exploratory Analysis of ChatGPT and Gemini Responses on False Positives in AI-Generated Text Detection
Online Learning In Educational Research (OLER) · 30.09.2026 · 6 (3) · 253-265
DOI: 10.58524/oler.v6i3.1284 ↗Kurz gefasst
Fachartikel in der Zeitschrift Online Learning In Educational Research (OLER), online erschienen am 30.09.2026. Verfasst von Ahmet Erdost Yastıbaş und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
The increasing use of AI tools has raised concerns about the mislabeling of human-written texts as AI-generated (i.e., false positives), potentially leading to unfair academic decisions in education settings. This study aimed to explore AI-based explanations for this misclassification and develop strategies that L2 teachers can use to reduce them. Adopting a qualitative framework, a textual corpus was created from responses by ChatGPT and Gemini to two prompts about mislabeling texts as AI-generated. The corpus comprised 4 responses totaling 2024 words. It was thematically analyzed. The findings showed that, according to ChatGPT and Gemini, there are five overarching themes regarding possible reasons: linguistic monotony, conventional writing patterns, bias related to non-native English writers, overly polished writing, and limitations of AI detection systems. According to the findings, ChatGPT and Gemini recommended three strategies for L2 teachers to minimize false positives: trace evidence of authors’ writing processes, customize their writing assessments, and use verification techniques in decision-making. Overall, this study contributes to the literature by providing a structured synthesis of AI-generated explanations of false positives and identifying pedagogically relevant strategies for L2 writing assessment, while emphasizing the importance of critically interpreting AI detection results.
Zitieren
APA
Yastıbaş, A. E., Dincer, A., & Darıyemez, T. (2026). An Exploratory Analysis of ChatGPT and Gemini Responses on False Positives in AI-Generated Text Detection. Online Learning In Educational Research (OLER), 6(3), 253-265. https://doi.org/10.58524/oler.v6i3.1284
Vancouver
Yastıbaş AE, Dincer A, Darıyemez T. An Exploratory Analysis of ChatGPT and Gemini Responses on False Positives in AI-Generated Text Detection. Online Learning In Educational Research (OLER). 2026;6(3):253-265. doi:10.58524/oler.v6i3.1284
BibTeX
@article{Yastba2026,
author = {Yastıbaş, Ahmet Erdost and Dincer, Ali and Darıyemez, Tevfik},
title = {An Exploratory Analysis of ChatGPT and Gemini Responses on False Positives in AI-Generated Text Detection},
journal = {Online Learning In Educational Research (OLER)},
year = {2026},
volume = {6},
number = {3},
pages = {253--265},
doi = {10.58524/oler.v6i3.1284}
}
EUVIMED