EUVIMEDEUVIMED entdecken
Crossref

Automated Assessment of Students' Critical Writing Skills with ChatGPT

Serdar Tekin, Şeyhmus Aydoğdu

International Journal of Educational Studies and Policy · 2025

DOI: 10.63612/ijesp.1735968 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Educational Studies and Policy, 2025. Verfasst von Serdar Tekin und 1 weiteren Autor:innen. Die Arbeit nennt 41 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Critical writing, a subskill of critical thinking, is a crucial skill for students to obtain in their education life. Since these skills require high-level cognitive skills such as analysis and evaluation, open-ended questions are used to evaluate students. Automated essay scoring (AES) tools can be used to overcome the difficulties in evaluating open-ended questions. This study aims to investigate the reliability of ChatGPT 3.5 as an AES tool for evaluating critical writing. It examines variations in average scores between a human rater and ChatGPT across diverse critical writing criteria, utilizing 59 essays from tertiary-level students majoring in teaching English as a foreign language. Reliability between raters was determined by intraclass correlation coefficients and the average score difference between raters was determined by Repeated Measures ANOVA. The findings indicate that ChatGPT, as an AES tool, demonstrates low reliability in assessing critical writing skills, suggesting its current role as a supplementary tool rather than a replacement for human raters. It was also found that ChatGPT tends to give higher scores than the human rater. The discussion aligns the results with existing literature, proposing future research avenues to leverage ChatGPT's potential as a supplementary tool for enhancing critical writing skills.

Zitieren

APA

Tekin, S., & Aydoğdu, Ş. (2025). Automated Assessment of Students' Critical Writing Skills with ChatGPT. International Journal of Educational Studies and Policy. https://doi.org/10.63612/ijesp.1735968

Vancouver

Tekin S, Aydoğdu Ş. Automated Assessment of Students' Critical Writing Skills with ChatGPT. International Journal of Educational Studies and Policy. 2025. doi:10.63612/ijesp.1735968

BibTeX
@article{Tekin2025,
  author = {Tekin, Serdar and Aydoğdu, Şeyhmus},
  title = {Automated Assessment of Students' Critical Writing Skills with ChatGPT},
  journal = {International Journal of Educational Studies and Policy},
  year = {2025},
  doi = {10.63612/ijesp.1735968}
}
Kostenlos starten →