Using tree-based ensemble methods to produce a population-based mortality risk score in Ontario, Canada
PLOS One · 23.04.2026 · 21 (4) · e0347302
DOI: 10.1371/journal.pone.0347302 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, online erschienen am 23.04.2026. Verfasst von Steven Habbous und 6 weiteren Autor:innen. Beteiligte Einrichtung: Ontario Health, Toronto, Ontario, Canada. Hauptthemen laut MEDLINE: Mortality, Risk Adjustment. Die Arbeit nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction
Risk adjustment is critical in observational epidemiology to control for confounding of the exposure-outcome relationship. Accurate prediction of outcomes, such as mortality, can improve risk adjustment. In the present study, we compared logistic regression with a range of tree-based ensemble methods to predict 1-year mortality in the general population of Ontario, Canada.
Methods
Ontario adults (age 18 years and older) who were alive as of January 1, 2022 were included. Using a window of up to 3 years, various measures of health and healthcare utilization were captured from administrative databases. To predict 1-year mortality, we applied logistic regression, random forests, extremely randomized trees, adaptive boosting, gradient boosting, extreme gradient boosting, Newton boosting, and CatBoost. All models also included age and sex. Performance was evaluated using the area under the ROC curve (AUROC), the area under the precision-recall curve (PR-AUC), the Brier score, and a quantile-based version of the Integrated Calibration Index (ICI), reported in the 30% test set. Feature importance was assessed using CatBoost’s internal model structure, supplemented with permutation feature importance, explainable boosted machines, and marginal effects.
Results
A total of 12,080,801 Ontarians were included and 121,951 (1.0%) died within 1 year. Logistic regression showed excellent discrimination (AUROC 0.926; PR-AUC 0.256) and acceptable calibration (ICI 0.0022). The best model was CatBoost, which had the best discrimination (AUROC 0.933, PR-AUC 0.280) and calibration (ICI 0.0003). In sensitivity analyses of the CatBoost model, including more detailed definitions of cancer (to include its subtype) and chronic kidney disease (defined using serum creatinine instead of diagnostic codes) produced modest improvements in PR-AUC (0.290), along with substantially improved calibration amongst the highest-risk (70–100%) individuals. The most influential model-building feature was age. Residence in long-term care and receipt of palliative care was associated with the largest marginal effects.
Conclusion
The machine learning model CatBoost yielded the most accurate predictive model for 1-year mortality using individual comorbidities and additional measures of healthcare utilization for the general population. These findings demonstrate that machine learning methods can enhance risk adjustment efforts in observational studies, leading to more accurate confounder control and better support for health policy and epidemiologic research.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Ontario Health, Toronto, Ontario, Canada.
- Department of Epidemiology and Biostatistics, Western University, London, Ontario, Canada.
- ICES, Toronto, Canada.
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada.
ORCID-Profile: Steven Habbous
Zitieren
APA
Habbous, S., Austin, P. C., Balamchi, S., Astaraky, D., Yousefi, R., Chaudhry, M., & Hellsten, E. (2026). Using tree-based ensemble methods to produce a population-based mortality risk score in Ontario, Canada. PLOS One, 21(4), e0347302. https://doi.org/10.1371/journal.pone.0347302
Vancouver
Habbous S, Austin PC, Balamchi S, Astaraky D, Yousefi R, Chaudhry M, et al. Using tree-based ensemble methods to produce a population-based mortality risk score in Ontario, Canada. PLOS One. 2026;21(4):e0347302. doi:10.1371/journal.pone.0347302
BibTeX
@article{Habbous2026,
author = {Habbous, Steven and Austin, Peter C and Balamchi, Shabnam and Astaraky, Davood and Yousefi, Roozbeh and Chaudhry, Munaza and Hellsten, Erik},
title = {Using tree-based ensemble methods to produce a population-based mortality risk score in Ontario, Canada},
journal = {PLOS One},
year = {2026},
volume = {21},
number = {4},
pages = {e0347302},
doi = {10.1371/journal.pone.0347302}
}
EUVIMED