A Comparative Analysis of Hyper-Parameter Optimization Methods for Predicting Heart Failure Outcomes
Applied Sciences · 20.03.2025 · 15 (6) · 3393
DOI: 10.3390/app15063393 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 20.03.2025. Verfasst von Qisthi Alhazmi Hidayaturrohman und 1 weiteren Autor:innen. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Themen: Herzinsuffizienz
Abstract (Originalsprache)
This study presents a comparative analysis of hyper-parameter optimization methods used in developing predictive models for patients at risk of heart failure readmission and mortality. We evaluated three optimization approaches—Grid Search (GS), Random Search (RS), and Bayesian Search (BS)—across three machine learning algorithms—Support Vector Machine (SVM), Random Forest (RF), and eXtreme Gradient Boosting (XGBoost). The models were built using real patient data from the Zigong Fourth People’s Hospital, which included 167 features from 2008 patients. The mean, MICE, kNN, and RF imputation techniques were implemented to handle missing values. Our initial results showed that SVM models outperformed the others, achieving an accuracy of up to 0.6294, sensitivity above 0.61, and an AUC score exceeding 0.66. However, after 10-fold cross-validation, the RF models demonstrated superior robustness, with an average AUC improvement of 0.03815, whereas the SVM models showed potential for overfitting, with a slight decline (−0.0074). The XGBoost models exhibited moderate improvement (+0.01683) post-validation. Bayesian Search had the best computational efficiency, consistently requiring less processing time than the Grid and Random Search methods. This study reveals that while model selection is crucial, an appropriate optimization method and imputation technique significantly impact model performance. These findings provide valuable insights for developing robust predictive models for healthcare applications, particularly for heart failure risk assessment.
Zitieren
APA
Hidayaturrohman, Q. A., & Hanada, E. (2025). A Comparative Analysis of Hyper-Parameter Optimization Methods for Predicting Heart Failure Outcomes. Applied Sciences, 15(6), 3393. https://doi.org/10.3390/app15063393
Vancouver
Hidayaturrohman QA, Hanada E. A Comparative Analysis of Hyper-Parameter Optimization Methods for Predicting Heart Failure Outcomes. Applied Sciences. 2025;15(6):3393. doi:10.3390/app15063393
BibTeX
@article{Hidayaturrohman2025,
author = {Hidayaturrohman, Qisthi Alhazmi and Hanada, Eisuke},
title = {A Comparative Analysis of Hyper-Parameter Optimization Methods for Predicting Heart Failure Outcomes},
journal = {Applied Sciences},
year = {2025},
volume = {15},
number = {6},
pages = {3393},
doi = {10.3390/app15063393}
}
EUVIMED