The Impact of Two Data‐Generating Processes for Competing Risk Data on the Discrimination and Calibration of Two Types of Competing Risk Regression Models
Statistics in Medicine · 2026
DOI: 10.1002/sim.70468 ↗At a glance
Journal article in Statistics in Medicine, 2026. Written by Peter C Austin and 1 co-authors. Institution: ICES, Toronto, Ontario, Canada. Major MEDLINE topics: Models, Statistical. Cited 2 times so far (Crossref); 20 references. The full text is freely available (open access, CC BY-NC 4.0). Funded by: CIHR, Ontario Ministry of Health (MOH), Ministry of Long-Term Care (MLTC).
Abstract (original language)
Monte Carlo simulations are an important tool in modern statistical research. The data‐generating process is foundational to any simulation. In survival analysis, a competing risk is an event whose occurrence precludes the occurrence of the primary event of interest. Two data‐generating processes have been described for simulating competing risk data: one based on all the cause‐specific hazard functions for the different types of events, and one based on a subdistribution hazard model for the primary event of interest. There is a paucity of research on the impact of the choice of data‐generating process. We used a series of Monte Carlo simulations to evaluate the impact of the choice of data‐generating process on the performance of prediction models when assessing discrimination using the time‐dependent AUC and accuracy using the time‐dependent Brier score. We also assessed the impact of the choice of competing risk regression used for computing smoothed event probabilities for use when computing the calibration metrics ICI (integrated calibration index), E50, and E90. The impact of discordance between the fitted model and the data‐generating process on both the time‐dependent AUC and the time‐dependent Brier score was minimal. When computing the ICI, E50, and E90, we recommend that researchers use a model for computing smoothed event probabilities that is concordant with the type of model whose calibration is being assessed.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- ICES, Toronto, Ontario, Canada.
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada.
- Sunnybrook Research Institute, Toronto, Ontario, Canada.
- Leiden University Medical Center, Leiden, the Netherlands.
ORCID profiles: Peter C Austin, Hein Putter
Funding
- CIHR
- Ontario Ministry of Health (MOH)
- Ministry of Long-Term Care (MLTC)
- Canadian Institutes of Health Research
Cite
APA
Austin, P. C., & Putter, H. (2026). The Impact of Two Data‐Generating Processes for Competing Risk Data on the Discrimination and Calibration of Two Types of Competing Risk Regression Models. Statistics in Medicine. https://doi.org/10.1002/sim.70468
Vancouver
Austin PC, Putter H. The Impact of Two Data‐Generating Processes for Competing Risk Data on the Discrimination and Calibration of Two Types of Competing Risk Regression Models. Statistics in Medicine. 2026. doi:10.1002/sim.70468
BibTeX
@article{Austin2026,
author = {Austin, Peter C and Putter, Hein},
title = {The Impact of Two Data‐Generating Processes for Competing Risk Data on the Discrimination and Calibration of Two Types of Competing Risk Regression Models},
journal = {Statistics in Medicine},
year = {2026},
doi = {10.1002/sim.70468}
}
EUVIMED