EUVIMEDDescobrir EUVIMED
Open access · CC BY-NC-ND 4.0

Pitfalls of the concordance index for survival outcomes

Nicholas Hartman iD, Sehee Kim, Kevin He iD, John D Kalbfleisch

Statistics in Medicine · 2023-06-15 · 42 (13) · 2179-2190

DOI: 10.1002/sim.9717 ↗

At a glance

Journal article in Statistics in Medicine, published online on 2023-03-28. Written by Nicholas Hartman and 3 co-authors. Institution: Department of Biostatistics, University of Michigan, Ann Arbor, MI, USA. Major MEDLINE topics: Prognosis. Cited 113 times so far (Crossref); 29 references. The full text is freely available (open access, CC BY-NC-ND 4.0). Funded by: NIDDK NIH HHS, National Institute of Diabetes and Digestive and Kidney Diseases.

ResumoSubjectsDados bibliográficosCiteRelated studies

Abstract (original language)

Prognostic models are useful tools for assessing a patient's risk of experiencing adverse health events. In practice, these models must be validated before implementation to ensure that they are clinically useful. The concordance index (C‐Index) is a popular statistic that is used for model validation, and it is often applied to models with binary or survival outcome variables. In this paper, we summarize existing criticism of the C‐Index and show that many limitations are accentuated when applied to survival outcomes, and to continuous outcomes more generally. We present several examples that show the challenges in achieving high concordance with survival outcomes, and we argue that the C‐Index is often not clinically meaningful in this setting. We derive a relationship between the concordance probability and the coefficient of determination under an ordinary least squares model with normally distributed predictors, which highlights the limitations of the C‐Index for continuous outcomes. Finally, we recommend existing alternatives that more closely align with common uses of survival models.

Subjects

MeSH terms (MEDLINE)

PrognosisHumansProbabilitySurvival Analysis

Author keywords

concordance indexprognostic modelingrisk discriminationsurvival analysis

Authors and institutions

  • Department of Biostatistics, University of Michigan, Ann Arbor, MI, USA.
  • Department of Clinical Epidemiology and Biostatistics, Asan Medical Center, Seoul, Republic of Korea.

ORCID profiles: Nicholas Hartman, Kevin He

Funding

  • NIDDK NIH HHS
  • National Institute of Diabetes and Digestive and Kidney Diseases

Cite

APA

Hartman, N., Kim, S., He, K., & Kalbfleisch, J. D. (2023). Pitfalls of the concordance index for survival outcomes. Statistics in Medicine, 42(13), 2179-2190. https://doi.org/10.1002/sim.9717

Vancouver

Hartman N, Kim S, He K, Kalbfleisch JD. Pitfalls of the concordance index for survival outcomes. Statistics in Medicine. 2023;42(13):2179-2190. doi:10.1002/sim.9717

BibTeX
@article{Hartman2023,
  author = {Hartman, Nicholas and Kim, Sehee and He, Kevin and Kalbfleisch, John D},
  title = {Pitfalls of the concordance index for survival outcomes},
  journal = {Statistics in Medicine},
  year = {2023},
  volume = {42},
  number = {13},
  pages = {2179--2190},
  doi = {10.1002/sim.9717}
}
Start for free →