EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Assessing the Validity of k-Fold Cross-Validation for Model Selection: Evidence from Bankruptcy Prediction Using Random Forest and XGBoost

Vlad Teodorescu, Laura Obreja Brașoveanu

Computation · 21.05.2025 · 13 (5) · 127

DOI: 10.3390/computation13050127 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computation, online erschienen am 21.05.2025. Verfasst von Vlad Teodorescu und 1 weiteren Autor:innen. Die Arbeit wurde bisher 91-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bucharest University of Economic Studies.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Predicting corporate bankruptcy is a key task in financial risk management, and selecting a machine learning model with superior generalization performance is crucial for prediction accuracy. This study evaluates the effectiveness of k-fold cross-validation as a model selection strategy for random forest and XGBoost classifiers using a publicly available dataset of Taiwanese listed companies. We employ a nested cross-validation framework to assess the relationship between cross-validation (CV) and out-of-sample (OOS) performance on 40 different train/test data partitions. On average, we find k-fold cross-validation to be a valid selection technique when applied within a model class; however, k-fold cross-validation may fail for specific train/test splits. We find that 67% of model selection regret variability is explained by the particular train/test split, highlighting an irreducible uncertainty real world practitioners must contend with. Our study extensively explores hyperparameter tuning for both classifiers and highlights key insights. Additionally, we investigate practical implementation choices in k-fold cross-validation—such as the value of k or prediction strategies. We conclude that k-fold cross-validation is effective for model selection within a model class and on average, but it can be unreliable in specific cases or when comparing models from different classes—this latter issue warranting further investigation.

Förderung

  • Bucharest University of Economic Studies

Zitieren

APA

Teodorescu, V., & Brașoveanu, L. O. (2025). Assessing the Validity of k-Fold Cross-Validation for Model Selection: Evidence from Bankruptcy Prediction Using Random Forest and XGBoost. Computation, 13(5), 127. https://doi.org/10.3390/computation13050127

Vancouver

Teodorescu V, Brașoveanu LO. Assessing the Validity of k-Fold Cross-Validation for Model Selection: Evidence from Bankruptcy Prediction Using Random Forest and XGBoost. Computation. 2025;13(5):127. doi:10.3390/computation13050127

BibTeX
@article{Teodorescu2025,
  author = {Teodorescu, Vlad and Brașoveanu, Laura Obreja},
  title = {Assessing the Validity of k-Fold Cross-Validation for Model Selection: Evidence from Bankruptcy Prediction Using Random Forest and XGBoost},
  journal = {Computation},
  year = {2025},
  volume = {13},
  number = {5},
  pages = {127},
  doi = {10.3390/computation13050127}
}
Kostenlos starten →