Pitfalls of the concordance index for survival outcomes
Statistics in Medicine · 2023-06-15 · 42 (13) · 2179-2190
DOI: 10.1002/sim.9717 ↗At a glance
Journal article in Statistics in Medicine, published online on 2023-03-28. Written by Nicholas Hartman and 3 co-authors. Institution: Department of Biostatistics, University of Michigan, Ann Arbor, MI, USA. Major MEDLINE topics: Prognosis. Cited 113 times so far (Crossref); 29 references. The full text is freely available (open access, CC BY-NC-ND 4.0). Funded by: NIDDK NIH HHS, National Institute of Diabetes and Digestive and Kidney Diseases.
Abstract (original language)
Prognostic models are useful tools for assessing a patient's risk of experiencing adverse health events. In practice, these models must be validated before implementation to ensure that they are clinically useful. The concordance index (C‐Index) is a popular statistic that is used for model validation, and it is often applied to models with binary or survival outcome variables. In this paper, we summarize existing criticism of the C‐Index and show that many limitations are accentuated when applied to survival outcomes, and to continuous outcomes more generally. We present several examples that show the challenges in achieving high concordance with survival outcomes, and we argue that the C‐Index is often not clinically meaningful in this setting. We derive a relationship between the concordance probability and the coefficient of determination under an ordinary least squares model with normally distributed predictors, which highlights the limitations of the C‐Index for continuous outcomes. Finally, we recommend existing alternatives that more closely align with common uses of survival models.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Biostatistics, University of Michigan, Ann Arbor, MI, USA.
- Department of Clinical Epidemiology and Biostatistics, Asan Medical Center, Seoul, Republic of Korea.
ORCID profiles: Nicholas Hartman, Kevin He
Funding
- NIDDK NIH HHS
- National Institute of Diabetes and Digestive and Kidney Diseases
Cite
APA
Hartman, N., Kim, S., He, K., & Kalbfleisch, J. D. (2023). Pitfalls of the concordance index for survival outcomes. Statistics in Medicine, 42(13), 2179-2190. https://doi.org/10.1002/sim.9717
Vancouver
Hartman N, Kim S, He K, Kalbfleisch JD. Pitfalls of the concordance index for survival outcomes. Statistics in Medicine. 2023;42(13):2179-2190. doi:10.1002/sim.9717
BibTeX
@article{Hartman2023,
author = {Hartman, Nicholas and Kim, Sehee and He, Kevin and Kalbfleisch, John D},
title = {Pitfalls of the concordance index for survival outcomes},
journal = {Statistics in Medicine},
year = {2023},
volume = {42},
number = {13},
pages = {2179--2190},
doi = {10.1002/sim.9717}
}
EUVIMED