EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Differential effects of GPT-based tools on comprehension of standardized passages

Hudson K. Etkin, Kai J. Etkin, Ryan J. Carter, Camarin E. Rolle

Frontiers in Education · 03.03.2025 · 10

DOI: 10.3389/feduc.2025.1506752 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Education, online erschienen am 03.03.2025. Verfasst von Hudson K. Etkin und 3 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Due to the rapidly improving capability of large language models such as Generative Pre-trained Transformer models (GPT), artificial intelligence (AI) based tools have entered use in education at scale. However, empirical data are largely lacking on the effects of AI tools on learning. Here, we determine the impact of four GPT-based tools on college-aged participants’ reading comprehension of standardized American College Test (ACT)-derived passages using a randomized cross-over online study ( n = 195). The four tools studied were AI-generated summaries, AI-generated outlines, a question-and-answer tutor chatbot, and a Socratic discussion chatbot. Consistent with our pre-registered hypotheses, we found a differential effect of AI tools as a function of baseline reading comprehension ability. AI tools significantly improved comprehension in lower performing participants and significantly worsened comprehension in higher performing participants. With respect to specific tools, low performers were most benefited by the Socratic chatbot while high performers were worsened most by the summary tool. These findings suggest that while AI tools have massive potential to enhance learning, blanket implementation may cause unintended harm to higher-performing students, calling for caution and further empirical study by developers and educators.

Zitieren

APA

Etkin, H. K., Etkin, K. J., Carter, R. J., & Rolle, C. E. (2025). Differential effects of GPT-based tools on comprehension of standardized passages. Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1506752

Vancouver

Etkin HK, Etkin KJ, Carter RJ, Rolle CE. Differential effects of GPT-based tools on comprehension of standardized passages. Frontiers in Education. 2025;10. doi:10.3389/feduc.2025.1506752

BibTeX
@article{Etkin2025,
  author = {Etkin, Hudson K. and Etkin, Kai J. and Carter, Ryan J. and Rolle, Camarin E.},
  title = {Differential effects of GPT-based tools on comprehension of standardized passages},
  journal = {Frontiers in Education},
  year = {2025},
  volume = {10},
  doi = {10.3389/feduc.2025.1506752}
}
Kostenlos starten →