Probabilistic Threshold Optimization on Machine Learning-Based Credit Scoring with DCA and Expected Loss
Integrated Journal of Artificial Intelligence and Data Science · 31.05.2026 · 2 (1) · 26-33
DOI: 10.68300/ijaids.v2i1.82 ↗Kurz gefasst
Fachartikel in der Zeitschrift Integrated Journal of Artificial Intelligence and Data Science, online erschienen am 31.05.2026. Verfasst von Watty Rimalia und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
High predictive performance in credit scoring models does not always translate into optimal financial decisions, particularly in imbalanced datasets where misclassification of high-risk borrowers leads to substantial losses. This study proposes a probability threshold optimization framework based on Decision Curve Analysis (DCA) and Expected Loss to align machine learning predictions with economic decision value. A dataset of 1,670,214 historical consumer credit records with 37 features was used. Logistic Regression and Random Forest models were developed and evaluated using classification metrics, followed by threshold tuning. Experimental results show that Random Forest achieves higher discrimination performance (ROC-AUC 0.8691, PR-AUC 0.9027), while Logistic Regression provides competitive predictive performance with better interpretability (F1-score 0.7845). Both models indicate an optimal probability threshold of 0.2. At this threshold, Logistic Regression yields the highest net benefit (0.81) and the lowest Expected Loss (IDR 1.21 billion). The findings demonstrate that integrating DCA and Expected Loss improves decision quality by reducing false-negative-driven financial risk compared to conventional metric-based evaluation. Overall, Logistic Regression with a 0.2 threshold is recommended for practical implementation in credit scoring systems due to its balance of accuracy, interpretability, and economic efficiency.
Zitieren
APA
Rimalia, W., Syam, H., Syam, R. F., Usman, S., & Arafah, M. N. (2026). Probabilistic Threshold Optimization on Machine Learning-Based Credit Scoring with DCA and Expected Loss. Integrated Journal of Artificial Intelligence and Data Science, 2(1), 26-33. https://doi.org/10.68300/ijaids.v2i1.82
Vancouver
Rimalia W, Syam H, Syam RF, Usman S, Arafah MN. Probabilistic Threshold Optimization on Machine Learning-Based Credit Scoring with DCA and Expected Loss. Integrated Journal of Artificial Intelligence and Data Science. 2026;2(1):26-33. doi:10.68300/ijaids.v2i1.82
BibTeX
@article{Rimalia2026,
author = {Rimalia, Watty and Syam, Hardiansyah and Syam, Rahmat Fuadi and Usman, Syahrul and Arafah, Muhammad Nur},
title = {Probabilistic Threshold Optimization on Machine Learning-Based Credit Scoring with DCA and Expected Loss},
journal = {Integrated Journal of Artificial Intelligence and Data Science},
year = {2026},
volume = {2},
number = {1},
pages = {26--33},
doi = {10.68300/ijaids.v2i1.82}
}
EUVIMED