Development of Automated Essay Scoring Using Retrieval Augmented Generation in SAGE
RIGGS: Journal of Artificial Intelligence and Digital Business · 23.05.2026 · 5 (2) · 4407-4415
DOI: 10.31004/riggs.v5i2.8979 ↗Kurz gefasst
Fachartikel in der Zeitschrift RIGGS: Journal of Artificial Intelligence and Digital Business, online erschienen am 23.05.2026. Verfasst von I Gusti Nyoman Sapta Wiguna und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Academic assessment through essay questions is a fundamental component of the educational ecosystem designed to measure students’ cognitive depth and critical reasoning. However, manual essay grading presents significant pedagogical and administrative challenges including high susceptibility to subjective bias and an overwhelming workload for educators. To address these critical issues this research develops the Smart Automated Grading Engine or SAGE, an advanced Learning Management System engineered to automate qualitative assessments. SAGE integrates large language models via the Gemini API with a robust Retrieval Augmented Generation architecture. By strictly grounding the artificial intelligence evaluation process in teacher curated reference documents and specific grading rubrics the system effectively neutralizes the risk of information hallucination. The system was empirically validated at SMAN 1 Blahbatuh involving 180 authentic essay responses from 36 eleventh grade students. The automated assessments were statistically compared against the manual evaluations of three expert history teachers. Comprehensive technical evaluations utilizing Black Box and White Box testing confirmed the platform absolute functional stability and architectural security. Crucially the accuracy testing demonstrated exceptional pedagogical reliability where the SAGE platform achieved a Quadratic Weighted Kappa coefficient of 0.9133 categorizing its performance as having almost perfect agreement. Furthermore, the system exhibited a remarkable precision rate of 94.44 percent within a stringent 10 point score tolerance. Ultimately the integration of this technology proves to be an effective objective and efficient solution capable of replicating human evaluation sharpness while significantly alleviating educator burnout.
Zitieren
APA
Wiguna, I. G. N. S., Pascima, I. B. N., & Damayanthi, L. P. E. (2026). Development of Automated Essay Scoring Using Retrieval Augmented Generation in SAGE. RIGGS: Journal of Artificial Intelligence and Digital Business, 5(2), 4407-4415. https://doi.org/10.31004/riggs.v5i2.8979
Vancouver
Wiguna IGNS, Pascima IBN, Damayanthi LPE. Development of Automated Essay Scoring Using Retrieval Augmented Generation in SAGE. RIGGS: Journal of Artificial Intelligence and Digital Business. 2026;5(2):4407-4415. doi:10.31004/riggs.v5i2.8979
BibTeX
@article{Wiguna2026,
author = {Wiguna, I Gusti Nyoman Sapta and Pascima, Ida Bagus Nyoman and Damayanthi, Luh Putu Eka},
title = {Development of Automated Essay Scoring Using Retrieval Augmented Generation in SAGE},
journal = {RIGGS: Journal of Artificial Intelligence and Digital Business},
year = {2026},
volume = {5},
number = {2},
pages = {4407--4415},
doi = {10.31004/riggs.v5i2.8979}
}
EUVIMED