Differential effects of GPT-based tools on comprehension of standardized passages
Frontiers in Education · 03.03.2025 · 10
DOI: 10.3389/feduc.2025.1506752 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Education, online erschienen am 03.03.2025. Verfasst von Hudson K. Etkin und 3 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Due to the rapidly improving capability of large language models such as Generative Pre-trained Transformer models (GPT), artificial intelligence (AI) based tools have entered use in education at scale. However, empirical data are largely lacking on the effects of AI tools on learning. Here, we determine the impact of four GPT-based tools on college-aged participants’ reading comprehension of standardized American College Test (ACT)-derived passages using a randomized cross-over online study ( n = 195). The four tools studied were AI-generated summaries, AI-generated outlines, a question-and-answer tutor chatbot, and a Socratic discussion chatbot. Consistent with our pre-registered hypotheses, we found a differential effect of AI tools as a function of baseline reading comprehension ability. AI tools significantly improved comprehension in lower performing participants and significantly worsened comprehension in higher performing participants. With respect to specific tools, low performers were most benefited by the Socratic chatbot while high performers were worsened most by the summary tool. These findings suggest that while AI tools have massive potential to enhance learning, blanket implementation may cause unintended harm to higher-performing students, calling for caution and further empirical study by developers and educators.
Zitieren
APA
Etkin, H. K., Etkin, K. J., Carter, R. J., & Rolle, C. E. (2025). Differential effects of GPT-based tools on comprehension of standardized passages. Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1506752
Vancouver
Etkin HK, Etkin KJ, Carter RJ, Rolle CE. Differential effects of GPT-based tools on comprehension of standardized passages. Frontiers in Education. 2025;10. doi:10.3389/feduc.2025.1506752
BibTeX
@article{Etkin2025,
author = {Etkin, Hudson K. and Etkin, Kai J. and Carter, Ryan J. and Rolle, Camarin E.},
title = {Differential effects of GPT-based tools on comprehension of standardized passages},
journal = {Frontiers in Education},
year = {2025},
volume = {10},
doi = {10.3389/feduc.2025.1506752}
}
EUVIMED