EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Grading assistance for a handwritten thermodynamics exam using artificial intelligence: An exploratory study

Gerd Kortemeyer, Julian Nöhl, Daria Onishchuk

Physical Review Physics Education Research · 12.11.2024 · 20 (2)

DOI: 10.1103/physrevphyseducres.20.020144 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Physical Review Physics Education Research, online erschienen am 12.11.2024. Verfasst von Gerd Kortemeyer und 2 weiteren Autor:innen. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

[This paper is part of the Focused Collection in Artificial Intelligence Tools in Physics Teaching and Physics Education Research.] Using a high-stakes thermodynamics exam as the sample (252 students, four multipart problems), we investigate the viability of four workflows for AI-assisted grading of handwritten student solutions. We find that the greatest challenge lies in converting handwritten answers into a machine-readable format. The granularity of grading criteria also influences grading performance: employing a fine-grained rubric for entire problems often leads to errors and grading failures, as the model appears to be unable to keep track of scores for more than a handful of rubric items, while grading problems in parts is more reliable but tends to miss nuances. We also found that grading hand-drawn graphics, such as process diagrams, is less reliable than mathematical derivations due to the difficulty in differentiating essential details from extraneous information. Although the system is precise in identifying exams that meet passing criteria, exams with failing grades still require human grading. We conclude with recommendations to overcome some of the encountered challenges. Published by the American Physical Society 2024

Zitieren

APA

Kortemeyer, G., Nöhl, J., & Onishchuk, D. (2024). Grading assistance for a handwritten thermodynamics exam using artificial intelligence: An exploratory study. Physical Review Physics Education Research, 20(2). https://doi.org/10.1103/physrevphyseducres.20.020144

Vancouver

Kortemeyer G, Nöhl J, Onishchuk D. Grading assistance for a handwritten thermodynamics exam using artificial intelligence: An exploratory study. Physical Review Physics Education Research. 2024;20(2). doi:10.1103/physrevphyseducres.20.020144

BibTeX
@article{Kortemeyer2024,
  author = {Kortemeyer, Gerd and Nöhl, Julian and Onishchuk, Daria},
  title = {Grading assistance for a handwritten thermodynamics exam using artificial intelligence: An exploratory study},
  journal = {Physical Review Physics Education Research},
  year = {2024},
  volume = {20},
  number = {2},
  doi = {10.1103/physrevphyseducres.20.020144}
}
Kostenlos starten →