Automated Tri Dharma Quality Assessment for Academic Accreditation Using Qwen, Mistral, and DeepSeek
Equilibrium: Jurnal Pendidikan · 22.05.2026 · 308-317
DOI: 10.26618/3zghgz16 ↗Kurz gefasst
Fachartikel in der Zeitschrift Equilibrium: Jurnal Pendidikan, online erschienen am 22.05.2026. Verfasst von Mochammad Ariel Sulton und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Internal Quality Audit (AMI) is critical for Indonesian higher-education accreditation, yet study programs still score 60+ indicators manually by cross-referencing a 200-page Self-Evaluation Report (LED) and a 50-sheet Study Program Performance Report (LKPS), a process that takes 3–5 days per program and varies between assessors. This study develops an automated quality-assessment agent that ingests both documents and benchmarks three open-weight Large Language Models, Qwen 3.5 35B, DeepSeek-R1 32B, and Mistral-Small 3.2 24B, on 19 LAM-Teknik indicators sampled across all nine accreditation criteria (9 qualitative, 6 quantitative, 4 composite). The reference scores are taken from the certified human assessor's official record produced during the program's 2024 post-audit cycle. The results show that Qwen 3.5 attains the lowest MAE (0.605) and RMSE (0.769) with 100% within ±1 accuracy and 32.5 s per indicator; DeepSeek-R1 is the most cautious but the slowest (MAE 1.395; 79.9 s) and collapses on quantitative items (MAE 2.17); Mistral is the fastest (13.6 s).
Zitieren
APA
Sulton, M. A., Karlita, T., Surapati, N. B., Nurmaida, F. P., Althaf, F. A., Mahardhika, Y. M., Lestari, P. E. W., & Rizki, A. B. (2026). Automated Tri Dharma Quality Assessment for Academic Accreditation Using Qwen, Mistral, and DeepSeek. Equilibrium: Jurnal Pendidikan, 308-317. https://doi.org/10.26618/3zghgz16
Vancouver
Sulton MA, Karlita T, Surapati NB, Nurmaida FP, Althaf FA, Mahardhika YM, et al. Automated Tri Dharma Quality Assessment for Academic Accreditation Using Qwen, Mistral, and DeepSeek. Equilibrium: Jurnal Pendidikan. 2026:308-317. doi:10.26618/3zghgz16
BibTeX
@article{Sulton2026,
author = {Sulton, Mochammad Ariel and Karlita, Tita and Surapati, Nyoman Bayu and Nurmaida, Firnanda Pristiana and Althaf, Faros Alaudin and Mahardhika, Yesta Medya and Lestari, Paramita Eka Wahyu and Rizki, Aris Bahari},
title = {Automated Tri Dharma Quality Assessment for Academic Accreditation Using Qwen, Mistral, and DeepSeek},
journal = {Equilibrium: Jurnal Pendidikan},
year = {2026},
pages = {308--317},
doi = {10.26618/3zghgz16}
}
EUVIMED