ChatGPT and Python programming homework
Decision Sciences Journal of Innovative Education · 2024-04 · 22 (2) · 74-87
DOI: 10.1111/dsji.12306 ↗Kurz gefasst
Fachartikel in der Zeitschrift Decision Sciences Journal of Innovative Education, online erschienen am 19.01.2024. Verfasst von Michael E. Ellis und 2 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 26 Literaturangaben.
Abstract (Originalsprache)
Large Language Model (LLM) artificial intelligence tools present a unique challenge for educators who teach programming languages. While LLMs like ChatGPT have been well documented for their ability to complete exams and create prose, there is a noticeable lack of research into their ability to solve problems using high‐level programming languages. Like many other university educators, those teaching programming courses would like to detect if students submit assignments generated by an LLM. To investigate grade performance and the likelihood of instructors identifying code generated by artificial intelligence (AI) tools, we compare code generated by students and ChatGPT for introductory Python homework assignments. Our research reveals mixed results on both counts, with ChatGPT performing like a mid‐range student on assignments and seasoned instructors struggling to detect AI‐generated code. This indicates that although AI‐generated results may not always be identifiable, they do not currently yield results approaching those of diligent students. We describe our methodology for selecting and evaluating the code examples, the results of our comparison, and the implications for future classes. We conclude with recommendations for how instructors of programming courses can mitigate student use of LLM tools as well as articulate the inherent value of preserving students’ individual creativity in producing programming languages.
Zitieren
APA
Ellis, M. E., Casey, K. M., & Hill, G. (2024). ChatGPT and Python programming homework. Decision Sciences Journal of Innovative Education, 22(2), 74-87. https://doi.org/10.1111/dsji.12306
Vancouver
Ellis ME, Casey KM, Hill G. ChatGPT and Python programming homework. Decision Sciences Journal of Innovative Education. 2024;22(2):74-87. doi:10.1111/dsji.12306
BibTeX
@article{Ellis2024,
author = {Ellis, Michael E. and Casey, K. Mike and Hill, Geoffrey},
title = {ChatGPT and Python programming homework},
journal = {Decision Sciences Journal of Innovative Education},
year = {2024},
volume = {22},
number = {2},
pages = {74--87},
doi = {10.1111/dsji.12306}
}
EUVIMED