EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Impact of Large Language Models on Programming Education and Student Learning Outcomes

Gregor Jošt, Viktor Taneski, Sašo Karakatič

Applied Sciences · 13.05.2024 · 14 (10) · 4115

DOI: 10.3390/app14104115 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 13.05.2024. Verfasst von Gregor Jošt und 2 weiteren Autor:innen. Die Arbeit wurde bisher 154-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Slovenian Research and Innovation Agency (ARIS).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advancements in Large Language Models (LLMs) like ChatGPT and Copilot have led to their integration into various educational domains, including software development education. Regular use of LLMs in the learning process is still not well-researched; thus, this paper intends to fill this gap. The paper explores the nuanced impact of informal LLM usage on undergraduate students’ learning outcomes in software development education, focusing on React applications. We carefully designed an experiment involving thirty-two participants over ten weeks where we examined unrestricted but not specifically encouraged LLM use and their correlation with student performance. Our results reveal a significant negative correlation between increased LLM reliance for critical thinking-intensive tasks such as code generation and debugging and lower final grades. Furthermore, a downward trend in final grades is observed with increased average LLM use across all tasks. However, the correlation between the use of LLMs for seeking additional explanations and final grades was not as strong, indicating that LLMs may serve better as a supplementary learning tool. These findings highlight the importance of balancing LLM integration with the cultivation of independent problem-solving skills in programming education.

Förderung

  • Slovenian Research and Innovation Agency (ARIS)

Zitieren

APA

Jošt, G., Taneski, V., & Karakatič, S. (2024). The Impact of Large Language Models on Programming Education and Student Learning Outcomes. Applied Sciences, 14(10), 4115. https://doi.org/10.3390/app14104115

Vancouver

Jošt G, Taneski V, Karakatič S. The Impact of Large Language Models on Programming Education and Student Learning Outcomes. Applied Sciences. 2024;14(10):4115. doi:10.3390/app14104115

BibTeX
@article{Jot2024,
  author = {Jošt, Gregor and Taneski, Viktor and Karakatič, Sašo},
  title = {The Impact of Large Language Models on Programming Education and Student Learning Outcomes},
  journal = {Applied Sciences},
  year = {2024},
  volume = {14},
  number = {10},
  pages = {4115},
  doi = {10.3390/app14104115}
}
Kostenlos starten →