EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Using tree-based ensemble methods to produce a population-based mortality risk score in Ontario, Canada

Steven Habbous iD, Peter C Austin, Shabnam Balamchi, Davood Astaraky, Roozbeh Yousefi, Munaza Chaudhry, Erik Hellsten

PLOS One · 23.04.2026 · 21 (4) · e0347302

DOI: 10.1371/journal.pone.0347302 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, online erschienen am 23.04.2026. Verfasst von Steven Habbous und 6 weiteren Autor:innen. Beteiligte Einrichtung: Ontario Health, Toronto, Ontario, Canada. Hauptthemen laut MEDLINE: Mortality, Risk Adjustment. Die Arbeit nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Risk adjustment is critical in observational epidemiology to control for confounding of the exposure-outcome relationship. Accurate prediction of outcomes, such as mortality, can improve risk adjustment. In the present study, we compared logistic regression with a range of tree-based ensemble methods to predict 1-year mortality in the general population of Ontario, Canada.

Methods

Ontario adults (age 18 years and older) who were alive as of January 1, 2022 were included. Using a window of up to 3 years, various measures of health and healthcare utilization were captured from administrative databases. To predict 1-year mortality, we applied logistic regression, random forests, extremely randomized trees, adaptive boosting, gradient boosting, extreme gradient boosting, Newton boosting, and CatBoost. All models also included age and sex. Performance was evaluated using the area under the ROC curve (AUROC), the area under the precision-recall curve (PR-AUC), the Brier score, and a quantile-based version of the Integrated Calibration Index (ICI), reported in the 30% test set. Feature importance was assessed using CatBoost’s internal model structure, supplemented with permutation feature importance, explainable boosted machines, and marginal effects.

Results

A total of 12,080,801 Ontarians were included and 121,951 (1.0%) died within 1 year. Logistic regression showed excellent discrimination (AUROC 0.926; PR-AUC 0.256) and acceptable calibration (ICI 0.0022). The best model was CatBoost, which had the best discrimination (AUROC 0.933, PR-AUC 0.280) and calibration (ICI 0.0003). In sensitivity analyses of the CatBoost model, including more detailed definitions of cancer (to include its subtype) and chronic kidney disease (defined using serum creatinine instead of diagnostic codes) produced modest improvements in PR-AUC (0.290), along with substantially improved calibration amongst the highest-risk (70–100%) individuals. The most influential model-building feature was age. Residence in long-term care and receipt of palliative care was associated with the largest marginal effects.

Conclusion

The machine learning model CatBoost yielded the most accurate predictive model for 1-year mortality using individual comorbidities and additional measures of healthcare utilization for the general population. These findings demonstrate that machine learning methods can enhance risk adjustment efforts in observational studies, leading to more accurate confounder control and better support for health policy and epidemiologic research.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

MortalityRisk AdjustmentOntarioHumansBoosting Machine Learning AlgorithmsFemaleMaleLogistic ModelsAgedRandom ForestAged, 80 and overMiddle AgedROC CurveAdult

Autor:innen und Institutionen

  • Ontario Health, Toronto, Ontario, Canada.
  • Department of Epidemiology and Biostatistics, Western University, London, Ontario, Canada.
  • ICES, Toronto, Canada.
  • Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada.

ORCID-Profile: Steven Habbous

Zitieren

APA

Habbous, S., Austin, P. C., Balamchi, S., Astaraky, D., Yousefi, R., Chaudhry, M., & Hellsten, E. (2026). Using tree-based ensemble methods to produce a population-based mortality risk score in Ontario, Canada. PLOS One, 21(4), e0347302. https://doi.org/10.1371/journal.pone.0347302

Vancouver

Habbous S, Austin PC, Balamchi S, Astaraky D, Yousefi R, Chaudhry M, et al. Using tree-based ensemble methods to produce a population-based mortality risk score in Ontario, Canada. PLOS One. 2026;21(4):e0347302. doi:10.1371/journal.pone.0347302

BibTeX
@article{Habbous2026,
  author = {Habbous, Steven and Austin, Peter C and Balamchi, Shabnam and Astaraky, Davood and Yousefi, Roozbeh and Chaudhry, Munaza and Hellsten, Erik},
  title = {Using tree-based ensemble methods to produce a population-based mortality risk score in Ontario, Canada},
  journal = {PLOS One},
  year = {2026},
  volume = {21},
  number = {4},
  pages = {e0347302},
  doi = {10.1371/journal.pone.0347302}
}
Kostenlos starten →