EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Automated Tri Dharma Quality Assessment for Academic Accreditation Using Qwen, Mistral, and DeepSeek

Mochammad Ariel Sulton, Tita Karlita, Nyoman Bayu Surapati, Firnanda Pristiana Nurmaida, Faros Alaudin Althaf, Yesta Medya Mahardhika, Paramita Eka Wahyu Lestari, Aris Bahari Rizki

Equilibrium: Jurnal Pendidikan · 22.05.2026 · 308-317

DOI: 10.26618/3zghgz16 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Equilibrium: Jurnal Pendidikan, online erschienen am 22.05.2026. Verfasst von Mochammad Ariel Sulton und 7 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Internal Quality Audit (AMI) is critical for Indonesian higher-education accreditation, yet study programs still score 60+ indicators manually by cross-referencing a 200-page Self-Evaluation Report (LED) and a 50-sheet Study Program Performance Report (LKPS), a process that takes 3–5 days per program and varies between assessors. This study develops an automated quality-assessment agent that ingests both documents and benchmarks three open-weight Large Language Models, Qwen 3.5 35B, DeepSeek-R1 32B, and Mistral-Small 3.2 24B, on 19 LAM-Teknik indicators sampled across all nine accreditation criteria (9 qualitative, 6 quantitative, 4 composite). The reference scores are taken from the certified human assessor's official record produced during the program's 2024 post-audit cycle. The results show that Qwen 3.5 attains the lowest MAE (0.605) and RMSE (0.769) with 100% within ±1 accuracy and 32.5 s per indicator; DeepSeek-R1 is the most cautious but the slowest (MAE 1.395; 79.9 s) and collapses on quantitative items (MAE 2.17); Mistral is the fastest (13.6 s).

Zitieren

APA

Sulton, M. A., Karlita, T., Surapati, N. B., Nurmaida, F. P., Althaf, F. A., Mahardhika, Y. M., Lestari, P. E. W., & Rizki, A. B. (2026). Automated Tri Dharma Quality Assessment for Academic Accreditation Using Qwen, Mistral, and DeepSeek. Equilibrium: Jurnal Pendidikan, 308-317. https://doi.org/10.26618/3zghgz16

Vancouver

Sulton MA, Karlita T, Surapati NB, Nurmaida FP, Althaf FA, Mahardhika YM, et al. Automated Tri Dharma Quality Assessment for Academic Accreditation Using Qwen, Mistral, and DeepSeek. Equilibrium: Jurnal Pendidikan. 2026:308-317. doi:10.26618/3zghgz16

BibTeX
@article{Sulton2026,
  author = {Sulton, Mochammad Ariel and Karlita, Tita and Surapati, Nyoman Bayu and Nurmaida, Firnanda Pristiana and Althaf, Faros Alaudin and Mahardhika, Yesta Medya and Lestari, Paramita Eka Wahyu and Rizki, Aris Bahari},
  title = {Automated Tri Dharma Quality Assessment for Academic Accreditation Using Qwen, Mistral, and DeepSeek},
  journal = {Equilibrium: Jurnal Pendidikan},
  year = {2026},
  pages = {308--317},
  doi = {10.26618/3zghgz16}
}
Kostenlos starten →