EUVIMEDEUVIMED entdecken
Crossref

Grading Open‐Ended Questions Using LLMs and RAG

Jacobo Farray Rodríguez, Antonio Jesús Fernández‐García, Elena Verdú

Expert Systems · 2026-01 · 43 (1)

DOI: 10.1111/exsy.70174 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Expert Systems, online erschienen am 28.11.2025. Verfasst von Jacobo Farray Rodríguez und 2 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 45 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Evaluating open‐ended questions is a common and time‐consuming task in education. With the continuous advances in natural language processing (NLP), large language models (LLMs) trained on massive datasets can assist in this process. This study evaluates the use of LLMs, complemented by retrieval‐augmented generation (RAG), for the numerical grading of open‐ended answers of approximately 250 words. We focus on two Spanish‐language technical courses and assess general‐purpose LLMs. Our results show that RAG improves grading accuracy, achieving reductions in mean absolute error (MAE) of up to 19.47% compared to using LLMs alone, with the best configuration reaching a MAE of 1.19. We also note that LLMs tend to assign high grades, reflecting the dataset's imbalance toward higher scores. This work demonstrates the potential of combining RAG with general‐purpose LLMs to evaluate specialised Spanish language content, avoiding the cost and bias of model fine‐tuning.

Zitieren

APA

Rodríguez, J. F., Fernández‐García, A. J., & Verdú, E. (2026). Grading Open‐Ended Questions Using LLMs and RAG. Expert Systems, 43(1). https://doi.org/10.1111/exsy.70174

Vancouver

Rodríguez JF, Fernández‐García AJ, Verdú E. Grading Open‐Ended Questions Using LLMs and RAG. Expert Systems. 2026;43(1). doi:10.1111/exsy.70174

BibTeX
@article{Rodrguez2026,
  author = {Rodríguez, Jacobo Farray and Fernández‐García, Antonio Jesús and Verdú, Elena},
  title = {Grading Open‐Ended Questions Using LLMs and RAG},
  journal = {Expert Systems},
  year = {2026},
  volume = {43},
  number = {1},
  doi = {10.1111/exsy.70174}
}
Kostenlos starten →