AI-assisted evaluation of revision patterns in young students’ argument writing
Frontiers in Education · 09.03.2026 · 11
DOI: 10.3389/feduc.2026.1736489 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Education, online erschienen am 09.03.2026. Verfasst von Tianwen Li und 6 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Revision is a crucial component of the writing process, yet few formative assessments focus on young students’ revision processes. This study explored an AI-assisted formative assessment that identifies revision patterns across drafts (i.e., first and second drafts) of students’ text-based argument writing. In particular, we examined the performance of GPT-4.1 in predicting revision patterns using two prompting strategies: few-shot prompting and few-shot Chain-of-Thought (CoT) prompting. The results show that GPT-4.1 exhibits strong potential for evaluating the revision process for formative purposes. It demonstrates excellent intra-rater reliability in predicting revision patterns across multiple runs. We also find that using CoT prompting that incorporates intermediate evaluation steps improves the accuracy of predicting explanation-focused revision patterns, a task that requires a more cognitively demanding evaluative process than assessing evidence-focused revisions. Implications for the conditions under which CoT prompting yields added value for enhancing prediction accuracy in writing evaluation are discussed.
Zitieren
APA
Li, T., Matsumura, L. C., Wang, E., Litman, D., Liu, Z., Correnti, R., & Hong, M. (2026). AI-assisted evaluation of revision patterns in young students’ argument writing. Frontiers in Education, 11. https://doi.org/10.3389/feduc.2026.1736489
Vancouver
Li T, Matsumura LC, Wang E, Litman D, Liu Z, Correnti R, et al. AI-assisted evaluation of revision patterns in young students’ argument writing. Frontiers in Education. 2026;11. doi:10.3389/feduc.2026.1736489
BibTeX
@article{Li2026,
author = {Li, Tianwen and Matsumura, Lindsay Clare and Wang, Elaine and Litman, Diane and Liu, Zhexiong and Correnti, Richard and Hong, Michelle},
title = {AI-assisted evaluation of revision patterns in young students’ argument writing},
journal = {Frontiers in Education},
year = {2026},
volume = {11},
doi = {10.3389/feduc.2026.1736489}
}
EUVIMED