Grading Open‐Ended Questions Using LLMs and RAG
Expert Systems · 2026-01 · 43 (1)
DOI: 10.1111/exsy.70174 ↗Kurz gefasst
Fachartikel in der Zeitschrift Expert Systems, online erschienen am 28.11.2025. Verfasst von Jacobo Farray Rodríguez und 2 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 45 Literaturangaben.
Abstract (Originalsprache)
Evaluating open‐ended questions is a common and time‐consuming task in education. With the continuous advances in natural language processing (NLP), large language models (LLMs) trained on massive datasets can assist in this process. This study evaluates the use of LLMs, complemented by retrieval‐augmented generation (RAG), for the numerical grading of open‐ended answers of approximately 250 words. We focus on two Spanish‐language technical courses and assess general‐purpose LLMs. Our results show that RAG improves grading accuracy, achieving reductions in mean absolute error (MAE) of up to 19.47% compared to using LLMs alone, with the best configuration reaching a MAE of 1.19. We also note that LLMs tend to assign high grades, reflecting the dataset's imbalance toward higher scores. This work demonstrates the potential of combining RAG with general‐purpose LLMs to evaluate specialised Spanish language content, avoiding the cost and bias of model fine‐tuning.
Zitieren
APA
Rodríguez, J. F., Fernández‐García, A. J., & Verdú, E. (2026). Grading Open‐Ended Questions Using LLMs and RAG. Expert Systems, 43(1). https://doi.org/10.1111/exsy.70174
Vancouver
Rodríguez JF, Fernández‐García AJ, Verdú E. Grading Open‐Ended Questions Using LLMs and RAG. Expert Systems. 2026;43(1). doi:10.1111/exsy.70174
BibTeX
@article{Rodrguez2026,
author = {Rodríguez, Jacobo Farray and Fernández‐García, Antonio Jesús and Verdú, Elena},
title = {Grading Open‐Ended Questions Using LLMs and RAG},
journal = {Expert Systems},
year = {2026},
volume = {43},
number = {1},
doi = {10.1111/exsy.70174}
}
EUVIMED