EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The death of the short-form physics essay in the coming AI revolution

Will Yeadon, Oto-Obong Inyang, Arin Mizouri, Alex Peach, Craig P Testrow

Physics Education · 01.05.2023 · 58 (3) · 035027

DOI: 10.1088/1361-6552/acc5cf ↗

Kurz gefasst

Fachartikel in der Zeitschrift Physics Education, online erschienen am 05.04.2023. Verfasst von Will Yeadon und 4 weiteren Autor:innen. Die Arbeit wurde bisher 144-mal zitiert (Crossref) und nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The latest AI language modules can produce original, high quality full short-form (300-word) Physics essays within seconds. These technologies such as ChatGPT and davinci-003 are freely available to anyone with an internet connection. In this work, we present evidence of AI generated short-form essays achieving First-Class grades on an essay writing assessment from an accredited, current university Physics module. The assessment requires students answer five open-ended questions with a short, 300-word essay each. Fifty AI answers were generated to create ten submissions that were independently marked by five separate markers. The AI generated submissions achieved an average mark of 71 ± 2 % , in strong agreement with the current module average of 71 ± 5 % . A typical AI submission would therefore most-likely be awarded a First Class, the highest classification available at UK universities. Plagiarism detection software returned a plagiarism score between 2 ± 1 % (Grammarly) and 7 ± 2 % (TurnitIn). We argue that these results indicate that current natural language processing AI represent a significant threat to the fidelity of short-form essays as an assessment method in Physics courses.

Zitieren

APA

Yeadon, W., Inyang, O., Mizouri, A., Peach, A., & Testrow, C. P. (2023). The death of the short-form physics essay in the coming AI revolution. Physics Education, 58(3), 035027. https://doi.org/10.1088/1361-6552/acc5cf

Vancouver

Yeadon W, Inyang O, Mizouri A, Peach A, Testrow CP. The death of the short-form physics essay in the coming AI revolution. Physics Education. 2023;58(3):035027. doi:10.1088/1361-6552/acc5cf

BibTeX
@article{Yeadon2023,
  author = {Yeadon, Will and Inyang, Oto-Obong and Mizouri, Arin and Peach, Alex and Testrow, Craig P},
  title = {The death of the short-form physics essay in the coming AI revolution},
  journal = {Physics Education},
  year = {2023},
  volume = {58},
  number = {3},
  pages = {035027},
  doi = {10.1088/1361-6552/acc5cf}
}
Kostenlos starten →