Evaluating the performance of 3 large language models in higher education essay-like assessments in 2024 and 2026
American Journal of STEM Education · 05.07.2026 · 25 · 279-304
DOI: 10.32674/tfptev94 ↗Kurz gefasst
Fachartikel in der Zeitschrift American Journal of STEM Education, online erschienen am 05.07.2026. Verfasst von David Hunt und 1 weiteren Autor:innen. Die Arbeit nennt 103 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Recent advances in artificial intelligence, especially generative large language models (LLMs), have transformed the higher education sector, raising concerns with academic integrity. The current literature lacks direct comparative analyses between LLMs. In the current study, we evaluated and compared the performance of ChatGPT, Gemini and Copilot (free versions) in 2024 and 2026, following prompts related to coursework essay assessments in computer science education or biomedical science. Our results indicate that LLMs struggle to abide by the word count beyond 1000 words, with Gemini presenting greater deviations. Copilot presented the lowest frequency of reference hallucinations. Overall performance of the 3 LLMs did not reveal any statistically significant differences. Quality assessments of the outputs revealed issues with content and criticality for all the LLMs. Similar performances were observed in 2024 and 2026.
Zitieren
APA
Hunt, D., & Miceli, M. D. (2026). Evaluating the performance of 3 large language models in higher education essay-like assessments in 2024 and 2026. American Journal of STEM Education, 25, 279-304. https://doi.org/10.32674/tfptev94
Vancouver
Hunt D, Miceli MD. Evaluating the performance of 3 large language models in higher education essay-like assessments in 2024 and 2026. American Journal of STEM Education. 2026;25:279-304. doi:10.32674/tfptev94
BibTeX
@article{Hunt2026,
author = {Hunt, David and Miceli, Mathieu Di},
title = {Evaluating the performance of 3 large language models in higher education essay-like assessments in 2024 and 2026},
journal = {American Journal of STEM Education},
year = {2026},
volume = {25},
pages = {279--304},
doi = {10.32674/tfptev94}
}
EUVIMED