LLMs in Automated Essay Evaluation: A Case Study
Proceedings of the AAAI Symposium Series · 20.05.2024 · 3 (1) · 143-147
DOI: 10.1609/aaaiss.v3i1.31193 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 20.05.2024. Verfasst von Milan Kostic und 3 weiteren Autor:innen. Die Arbeit wurde bisher 26-mal zitiert (Crossref).
Abstract (Originalsprache)
This study delves into the application of large language models (LLMs), such as ChatGPT-4, for the automated evaluation of student essays, with a focus on a case study conducted at the Swiss Institute of Business Administration. It explores the effectiveness of LLMs in assessing German-language student transfer assignments, and contrasts their performance with traditional evaluations by human lecturers. The primary findings highlight the challenges faced by LLMs in terms of accurately grading complex texts according to predefined categories and providing detailed feedback. This research illuminates the gap between the capabilities of LLMs and the nuanced requirements of student essay evaluation. The conclusion emphasizes the necessity for ongoing research and development in the area of LLM technology to improve the accuracy, reliability, and consistency of automated essay assessments in educational contexts.
Zitieren
APA
Kostic, M., Witschel, H. F., Hinkelmann, K., & Spahic-Bogdanovic, M. (2024). LLMs in Automated Essay Evaluation: A Case Study. Proceedings of the AAAI Symposium Series, 3(1), 143-147. https://doi.org/10.1609/aaaiss.v3i1.31193
Vancouver
Kostic M, Witschel HF, Hinkelmann K, Spahic-Bogdanovic M. LLMs in Automated Essay Evaluation: A Case Study. Proceedings of the AAAI Symposium Series. 2024;3(1):143-147. doi:10.1609/aaaiss.v3i1.31193
BibTeX
@article{Kostic2024,
author = {Kostic, Milan and Witschel, Hans Friedrich and Hinkelmann, Knut and Spahic-Bogdanovic, Maja},
title = {LLMs in Automated Essay Evaluation: A Case Study},
journal = {Proceedings of the AAAI Symposium Series},
year = {2024},
volume = {3},
number = {1},
pages = {143--147},
doi = {10.1609/aaaiss.v3i1.31193}
}
EUVIMED