EUVIMEDEUVIMED entdecken
Crossref

Optimized Stacking Ensemble of Random Forest and XGBoost for Heart Disease Prediction

U. Sani, A. A. Abubakar, D. G. Lazarus, A. A. Babajo

Researchers Journal of Science and Technology · 19.04.2026

DOI: 10.83080/rejost.vol6no3.281 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Researchers Journal of Science and Technology, erschienen am 19.04.2026. Verfasst von U. Sani und 3 weiteren Autor:innen.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Heart disease remains a leading cause of death worldwide, highlighting the need for reliable tools to support early diagnosis and clinical decision-making. Although machine learning methods have been widely applied to heart disease prediction, many existing studies rely on default model settings, limited evaluation metrics, and a narrow range of algorithms. This study develops an optimized stacking ensemble model that combines Random Forest and XGBoost, with hyperparameters tuned using Optuna. The models were evaluated using a publicly available clinical dataset comprising 918 patient records with demographic and cardiovascular attributes. An 80:20 train-test split was applied, and performance was assessed using multiple metrics, including accuracy, macro and weighted F1-score, ROC-AUC, PR-AUC, and balanced accuracy. The results show that the optimized Random Forest achieved an accuracy of 89.1% and a ROC-AUC of 93.4%, while XGBoost achieved an accuracy of 88.6% with a similar ROC-AUC. The stacking ensemble provided the best overall performance, with an accuracy of 89.7%, macro F1-score of 89.6%, ROC-AUC of 93.6%, and PR-AUC of 93.5%. These findings suggest that combining optimized ensemble models can improve predictive performance compared to individual classifiers. However, the results are based on a secondary dataset and have not been validated in real clinical settings, which may limit their direct applicability in practice. Overall, this study contributes by demonstrating the value of hyperparameter optimization and model stacking, while adopting a broader evaluation framework for heart disease prediction.

Schlagwörter

heart disease predictionstacking ensemblerandom forestXGBoosthyperparameter optimizationOptunaearly diagnosis

Zitieren

APA

Sani, U., Abubakar, A. A., Lazarus, D. G., & Babajo, A. A. (2026). Optimized Stacking Ensemble of Random Forest and XGBoost for Heart Disease Prediction. Researchers Journal of Science and Technology. https://doi.org/10.83080/rejost.vol6no3.281

Vancouver

Sani U, Abubakar AA, Lazarus DG, Babajo AA. Optimized Stacking Ensemble of Random Forest and XGBoost for Heart Disease Prediction. Researchers Journal of Science and Technology. 2026. doi:10.83080/rejost.vol6no3.281

BibTeX
@article{Sani2026,
  author = {Sani, U. and Abubakar, A. A. and Lazarus, D. G. and Babajo, A. A.},
  title = {Optimized Stacking Ensemble of Random Forest and XGBoost for Heart Disease Prediction},
  journal = {Researchers Journal of Science and Technology},
  year = {2026},
  doi = {10.83080/rejost.vol6no3.281}
}
Kostenlos starten →