EUVIMEDEUVIMED entdecken
Crossref

LLMs in Automated Essay Evaluation: A Case Study

Milan Kostic, Hans Friedrich Witschel, Knut Hinkelmann, Maja Spahic-Bogdanovic

Proceedings of the AAAI Symposium Series · 20.05.2024 · 3 (1) · 143-147

DOI: 10.1609/aaaiss.v3i1.31193 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 20.05.2024. Verfasst von Milan Kostic und 3 weiteren Autor:innen. Die Arbeit wurde bisher 26-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study delves into the application of large language models (LLMs), such as ChatGPT-4, for the automated evaluation of student essays, with a focus on a case study conducted at the Swiss Institute of Business Administration. It explores the effectiveness of LLMs in assessing German-language student transfer assignments, and contrasts their performance with traditional evaluations by human lecturers. The primary findings highlight the challenges faced by LLMs in terms of accurately grading complex texts according to predefined categories and providing detailed feedback. This research illuminates the gap between the capabilities of LLMs and the nuanced requirements of student essay evaluation. The conclusion emphasizes the necessity for ongoing research and development in the area of LLM technology to improve the accuracy, reliability, and consistency of automated essay assessments in educational contexts.

Zitieren

APA

Kostic, M., Witschel, H. F., Hinkelmann, K., & Spahic-Bogdanovic, M. (2024). LLMs in Automated Essay Evaluation: A Case Study. Proceedings of the AAAI Symposium Series, 3(1), 143-147. https://doi.org/10.1609/aaaiss.v3i1.31193

Vancouver

Kostic M, Witschel HF, Hinkelmann K, Spahic-Bogdanovic M. LLMs in Automated Essay Evaluation: A Case Study. Proceedings of the AAAI Symposium Series. 2024;3(1):143-147. doi:10.1609/aaaiss.v3i1.31193

BibTeX
@article{Kostic2024,
  author = {Kostic, Milan and Witschel, Hans Friedrich and Hinkelmann, Knut and Spahic-Bogdanovic, Maja},
  title = {LLMs in Automated Essay Evaluation: A Case Study},
  journal = {Proceedings of the AAAI Symposium Series},
  year = {2024},
  volume = {3},
  number = {1},
  pages = {143--147},
  doi = {10.1609/aaaiss.v3i1.31193}
}
Kostenlos starten →