EUVIMEDEUVIMED entdecken
Systematische ÜbersichtOpen Access · CC BY 4.0

Large Language Model-Powered Automated Assessment: A Systematic Review

Emrah Emirtekin

Applied Sciences · 20.05.2025 · 15 (10) · 5683

DOI: 10.3390/app15105683 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift Applied Sciences, online erschienen am 20.05.2025. Verfasst von Emrah Emirtekin. Die Arbeit wurde bisher 78-mal zitiert (Crossref) und nennt 90 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This systematic review investigates 49 peer-reviewed studies on Large Language Model-Powered Automated Assessment (LLMPAA) published between 2018 and 2024. Following PRISMA guidelines, studies were selected from Web of Science, Scopus, IEEE, ACM Digital Library, and PubMed databases. The analysis shows that LLMPAA has been widely applied in reading comprehension, language education, and computer science, primarily using essay and short-answer formats. While models such as GPT-4 and fine-tuned BERT often exhibit high agreement with human raters (e.g., QWK = 0.99, r = 0.95), other studies report lower agreement (e.g., ICC = 0.45, r = 0.38). LLMPAA offers benefits like efficiency, scalability, and personalized feedback. However, significant challenges remain, including bias, inconsistency, hallucination, limited explainability, dataset quality, and privacy concerns. These findings indicate that while LLMPAA technologies hold promise, their effectiveness varies by context. Human oversight is essential to ensure fair and reliable assessment outcomes.

Zitieren

APA

Emirtekin, E. (2025). Large Language Model-Powered Automated Assessment: A Systematic Review. Applied Sciences, 15(10), 5683. https://doi.org/10.3390/app15105683

Vancouver

Emirtekin E. Large Language Model-Powered Automated Assessment: A Systematic Review. Applied Sciences. 2025;15(10):5683. doi:10.3390/app15105683

BibTeX
@article{Emirtekin2025,
  author = {Emirtekin, Emrah},
  title = {Large Language Model-Powered Automated Assessment: A Systematic Review},
  journal = {Applied Sciences},
  year = {2025},
  volume = {15},
  number = {10},
  pages = {5683},
  doi = {10.3390/app15105683}
}
Kostenlos starten →