Assessing the Validity of k-Fold Cross-Validation for Model Selection: Evidence from Bankruptcy Prediction Using Random Forest and XGBoost
Computation · 21.05.2025 · 13 (5) · 127
DOI: 10.3390/computation13050127 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computation, online erschienen am 21.05.2025. Verfasst von Vlad Teodorescu und 1 weiteren Autor:innen. Die Arbeit wurde bisher 91-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bucharest University of Economic Studies.
Abstract (Originalsprache)
Predicting corporate bankruptcy is a key task in financial risk management, and selecting a machine learning model with superior generalization performance is crucial for prediction accuracy. This study evaluates the effectiveness of k-fold cross-validation as a model selection strategy for random forest and XGBoost classifiers using a publicly available dataset of Taiwanese listed companies. We employ a nested cross-validation framework to assess the relationship between cross-validation (CV) and out-of-sample (OOS) performance on 40 different train/test data partitions. On average, we find k-fold cross-validation to be a valid selection technique when applied within a model class; however, k-fold cross-validation may fail for specific train/test splits. We find that 67% of model selection regret variability is explained by the particular train/test split, highlighting an irreducible uncertainty real world practitioners must contend with. Our study extensively explores hyperparameter tuning for both classifiers and highlights key insights. Additionally, we investigate practical implementation choices in k-fold cross-validation—such as the value of k or prediction strategies. We conclude that k-fold cross-validation is effective for model selection within a model class and on average, but it can be unreliable in specific cases or when comparing models from different classes—this latter issue warranting further investigation.
Förderung
- Bucharest University of Economic Studies
Zitieren
APA
Teodorescu, V., & Brașoveanu, L. O. (2025). Assessing the Validity of k-Fold Cross-Validation for Model Selection: Evidence from Bankruptcy Prediction Using Random Forest and XGBoost. Computation, 13(5), 127. https://doi.org/10.3390/computation13050127
Vancouver
Teodorescu V, Brașoveanu LO. Assessing the Validity of k-Fold Cross-Validation for Model Selection: Evidence from Bankruptcy Prediction Using Random Forest and XGBoost. Computation. 2025;13(5):127. doi:10.3390/computation13050127
BibTeX
@article{Teodorescu2025,
author = {Teodorescu, Vlad and Brașoveanu, Laura Obreja},
title = {Assessing the Validity of k-Fold Cross-Validation for Model Selection: Evidence from Bankruptcy Prediction Using Random Forest and XGBoost},
journal = {Computation},
year = {2025},
volume = {13},
number = {5},
pages = {127},
doi = {10.3390/computation13050127}
}
EUVIMED