EUVIMEDEUVIMED entdecken
LeitlinieOpen Access · CC BY 4.0

Guidelines For Automatic Grading of Student Essays Using Large Language Models

Diwakar Yalpi, Sruta Keerti Kasula, Ravi Mukkamala

The Eurasia Proceedings of Educational and Social Sciences · 30.06.2026 · 49 · 228-244

DOI: 10.55549/epess.1037 ↗

Kurz gefasst

Leitlinie in der Zeitschrift The Eurasia Proceedings of Educational and Social Sciences, online erschienen am 30.06.2026. Verfasst von Diwakar Yalpi und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated essay evaluation using large language models (LLMs) has emerged as a promising approach to support scalable and consistent educational assessment. However, the effectiveness of LLM-based grading varies significantly across evaluation dimensions and is highly influenced by prompt design and model selection. In this study, we evaluate five state-of-the-art LLMs across five rubric-based categories: Relevance to Question, Reasoning and Critical Thinking, Evidence and Examples, Organization, and Clarity and Writing Quality. We systematically investigate the impact of three prompting strategies, including rubric-only prompting, exemplar-based prompting (with and without rubric guidance)(Original and Refined prompt designs) incorporating structured instructions. Additionally, a prompt ablation study is conducted to analyze the effect of instruction detail and reasoning guidance on grading accuracy. Our results demonstrate that no single model consistently outperforms others across all categories. Instead, each LLM exhibits strengths in specific evaluation dimensions, motivating a category-wise model selection approach. Furthermore, refined and structured prompting strategies significantly improve evaluation performance, with chain-of-thought-style instructions yielding the highest accuracy. These findings highlight the importance of both prompt engineering and task-specialized model allocation in developing robust LLM-based grading systems. The study provides evidence supporting multi-agent frameworks, where different LLMs can be assigned to distinct evaluation tasks to enhance overall grading reliability and alignment with human judgments.

Zitieren

APA

Yalpi, D., Kasula, S. K., & Mukkamala, R. (2026). Guidelines For Automatic Grading of Student Essays Using Large Language Models. The Eurasia Proceedings of Educational and Social Sciences, 49, 228-244. https://doi.org/10.55549/epess.1037

Vancouver

Yalpi D, Kasula SK, Mukkamala R. Guidelines For Automatic Grading of Student Essays Using Large Language Models. The Eurasia Proceedings of Educational and Social Sciences. 2026;49:228-244. doi:10.55549/epess.1037

BibTeX
@article{Yalpi2026,
  author = {Yalpi, Diwakar and Kasula, Sruta Keerti and Mukkamala, Ravi},
  title = {Guidelines For Automatic Grading of Student Essays Using Large Language Models},
  journal = {The Eurasia Proceedings of Educational and Social Sciences},
  year = {2026},
  volume = {49},
  pages = {228--244},
  doi = {10.55549/epess.1037}
}
Kostenlos starten →