The death of the short-form physics essay in the coming AI revolution
Physics Education · 01.05.2023 · 58 (3) · 035027
DOI: 10.1088/1361-6552/acc5cf ↗Kurz gefasst
Fachartikel in der Zeitschrift Physics Education, online erschienen am 05.04.2023. Verfasst von Will Yeadon und 4 weiteren Autor:innen. Die Arbeit wurde bisher 144-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The latest AI language modules can produce original, high quality full short-form (300-word) Physics essays within seconds. These technologies such as ChatGPT and davinci-003 are freely available to anyone with an internet connection. In this work, we present evidence of AI generated short-form essays achieving First-Class grades on an essay writing assessment from an accredited, current university Physics module. The assessment requires students answer five open-ended questions with a short, 300-word essay each. Fifty AI answers were generated to create ten submissions that were independently marked by five separate markers. The AI generated submissions achieved an average mark of 71 ± 2 % , in strong agreement with the current module average of 71 ± 5 % . A typical AI submission would therefore most-likely be awarded a First Class, the highest classification available at UK universities. Plagiarism detection software returned a plagiarism score between 2 ± 1 % (Grammarly) and 7 ± 2 % (TurnitIn). We argue that these results indicate that current natural language processing AI represent a significant threat to the fidelity of short-form essays as an assessment method in Physics courses.
Zitieren
APA
Yeadon, W., Inyang, O., Mizouri, A., Peach, A., & Testrow, C. P. (2023). The death of the short-form physics essay in the coming AI revolution. Physics Education, 58(3), 035027. https://doi.org/10.1088/1361-6552/acc5cf
Vancouver
Yeadon W, Inyang O, Mizouri A, Peach A, Testrow CP. The death of the short-form physics essay in the coming AI revolution. Physics Education. 2023;58(3):035027. doi:10.1088/1361-6552/acc5cf
BibTeX
@article{Yeadon2023,
author = {Yeadon, Will and Inyang, Oto-Obong and Mizouri, Arin and Peach, Alex and Testrow, Craig P},
title = {The death of the short-form physics essay in the coming AI revolution},
journal = {Physics Education},
year = {2023},
volume = {58},
number = {3},
pages = {035027},
doi = {10.1088/1361-6552/acc5cf}
}
EUVIMED