Explainable Machine Learning for Predicting Indonesian Vocational School Accreditation: Geographic Validation, Probability Calibration, and Subgroup Auditing
Journal of Computing Theories and Applications · 12.09.2026 · 4 (2) · 502-516
DOI: 10.62411/jcta.17721 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computing Theories and Applications, online erschienen am 12.09.2026. Verfasst von Muhamad Riyan Maulana und 5 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Vocational school accreditation is a high-stakes institutional classification, yet the geographic transferability and probability reliability of models based on routinely collected administrative data remain underexplored. This study developed a reproducible, leakage-controlled machine-learning framework for classifying the recorded accreditation classes C, B, and A among Indonesian vocational schools. Its main contribution is an integrated evaluation design that combines province-disjoint validation, probability calibration, cluster-aware uncertainty, and subgroup auditing to test reliability beyond conventional random-validation performance. A cross-sectional dataset containing 149,376 program-level records was deterministically aggregated into 14,391 schools, including 14,134 with valid labels. Eight provinces comprising 1,536 schools were locked before feature selection, model comparison, tuning, and calibration; 12,598 schools from 31 provinces supported development. The selected CatBoost model used 35 structural and vocational features with grouped out-of-fold temperature scaling. On the locked holdout, the calibrated model achieved balanced accuracy of 0.586, Macro F1 of 0.533, quadratic weighted kappa of 0.499, Macro ROC-AUC of 0.757, and expected calibration error of 0.049. School size, teacher resources, vocational staffing, program diversity, and status were most in-fluential. Class B had the lowest recall, and performance varied across school groups and provinces. The framework supports calibrated, auditable preliminary screening, but not automated accreditation or replacement of professional assessors.
Zitieren
APA
Maulana, M. R., Sudira, P., Priyanto, P., Fadlullah, Y. A., Nurdiana, D., & Subhi, A. H. B. S. (2026). Explainable Machine Learning for Predicting Indonesian Vocational School Accreditation: Geographic Validation, Probability Calibration, and Subgroup Auditing. Journal of Computing Theories and Applications, 4(2), 502-516. https://doi.org/10.62411/jcta.17721
Vancouver
Maulana MR, Sudira P, Priyanto P, Fadlullah YA, Nurdiana D, Subhi AHBS. Explainable Machine Learning for Predicting Indonesian Vocational School Accreditation: Geographic Validation, Probability Calibration, and Subgroup Auditing. Journal of Computing Theories and Applications. 2026;4(2):502-516. doi:10.62411/jcta.17721
BibTeX
@article{Maulana2026,
author = {Maulana, Muhamad Riyan and Sudira, Putu and Priyanto, Priyanto and Fadlullah, Yanuar Agung and Nurdiana, Dian and Subhi, Amir Hamzah Bin Sofhi @},
title = {Explainable Machine Learning for Predicting Indonesian Vocational School Accreditation: Geographic Validation, Probability Calibration, and Subgroup Auditing},
journal = {Journal of Computing Theories and Applications},
year = {2026},
volume = {4},
number = {2},
pages = {502--516},
doi = {10.62411/jcta.17721}
}
EUVIMED