A Leakage-Aware Ensemble Framework for Imbalanced Tabular Data: Mitigating SMOTE Contamination in Hotel Cancellation Prediction
Journal Computer and Technology · 2026
DOI: 10.69916/comtechno.v4i1.514 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal Computer and Technology, 2026. Verfasst von Gibran Maulana Syamroni und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Predictive modeling on large-scale, imbalanced tabular data is frequently compromised by target leakage and improper resampling, leading to inflated performance metrics. While tree-based ensemble methods like Random Forest (RF) and XGBoost are widely deployed, their architectural divergence in handling complex behavioral anomalies under strict class imbalance remains underexplored. This study proposes a leakage-aware ensemble framework to mitigate SMOTE contamination and target leakage in hotel cancellation prediction. Using a rigorous CRISP-DM pipeline on 119,390 records, we applied SMOTE exclusively to the training set and engineered six behavioral features to capture non-linear contradictions, such as the counter-intuitive 99.36% cancellation rate in non-refund deposits. We systematically benchmarked RF (bagging) against XGBoost (boosting) using stratified 5-fold cross-validation, hyperparameter optimization, and loss curve monitoring. Results demonstrate that XGBoost structurally outperforms RF in minority-class detection, achieving superior Recall (0.6659), F1-Score (0.6607), and AUC-ROC (0.8657), with significantly lower variance (0.0035). Conversely, RF exhibited higher Precision (0.6588) and better cross-validation stability during hyperparameter search. Crucially, feature importance analysis revealed a structural divergence: RF prioritized temporal variables (lead_time), while XGBoost emphasized behavioral commitment signals (parking, special requests). These findings confirm that gradient boosting’s sequential residual-correction mechanism is inherently more robust than variance-reduction bagging for imbalanced tabular data containing complex, non-linear anomalies. The proposed leakage-free framework not only resolves methodological flaws in prior studies but also provides a reliable, proactive risk-scoring foundation for integrating real-time decision support systems in production environments.
Zitieren
APA
Syamroni, G. M., Imran, B., Erniwati, S., Zaeniah, & Wahyuni, W. A. (2026). A Leakage-Aware Ensemble Framework for Imbalanced Tabular Data: Mitigating SMOTE Contamination in Hotel Cancellation Prediction. Journal Computer and Technology. https://doi.org/10.69916/comtechno.v4i1.514
Vancouver
Syamroni GM, Imran B, Erniwati S, Zaeniah, Wahyuni WA. A Leakage-Aware Ensemble Framework for Imbalanced Tabular Data: Mitigating SMOTE Contamination in Hotel Cancellation Prediction. Journal Computer and Technology. 2026. doi:10.69916/comtechno.v4i1.514
BibTeX
@article{Syamroni2026,
author = {Syamroni, Gibran Maulana and Imran, Bahtiar and Erniwati, Surni and Zaeniah and Wahyuni, Wenti Ayu},
title = {A Leakage-Aware Ensemble Framework for Imbalanced Tabular Data: Mitigating SMOTE Contamination in Hotel Cancellation Prediction},
journal = {Journal Computer and Technology},
year = {2026},
doi = {10.69916/comtechno.v4i1.514}
}
EUVIMED