EUVIMEDSkopri EUVIMED
Open access · CC BY-NC 4.0

Extending the DeLong algorithm for comparing areas under correlated receiver operating characteristic curves with missing data

Lily Zou, Yun-Hee Choi iD, Leonardo Guizzetti iD, Di Shu iD, Joshua Zou, Guangyong Zou iD

Statistics in Medicine · 2024-09-20 · 43 (21) · 4148-4162

DOI: 10.1002/sim.10172 ↗

At a glance

Journal article in Statistics in Medicine, published online on 2024-07-16. Written by Lily Zou and 5 co-authors. Institution: Department of Statistics and Actuarial Science, University of Waterloo, Waterloo, Ontario, Canada. Major MEDLINE topics: Algorithms, ROC Curve, Computer Simulation, Area Under Curve. Cited 32 times so far (Crossref); 38 references. The full text is freely available (open access, CC BY-NC 4.0). Funded by: Natural Sciences and Engineering Research Council of Canada.

AstrattSubjectsDettalji biblijografiċiCiteRelated studies

Abstract (original language)

A nonparametric method proposed by DeLong et al in 1988 for comparing areas under correlated receiver operating characteristic curves is used widely in practice. However, the DeLong method as implemented in popular software quietly deletes individuals with any missing values, yielding potentially invalid and/or inefficient results. We simplify the DeLong algorithm using ranks and extend it to accommodate missing data by using a mixed model approach for multivariate data. Simulation results demonstrate the validity and efficiency of our procedure for data missing at random. We illustrate our proposed procedure in SAS, Stata, and R using the original DeLong data.

Subjects

MeSH terms (MEDLINE)

AlgorithmsROC CurveComputer SimulationArea Under CurveHumansModels, StatisticalStatistics, NonparametricData Interpretation, StatisticalMultivariate Analysis

Author keywords

Behrens‐FisherWilcoxon‐Mann‐Whitney testbiomarkersconcordancediagnostic testseffect sizemissing at randommixed modelsnonparametricranksresponsiveness

Authors and institutions

  • Department of Statistics and Actuarial Science, University of Waterloo, Waterloo, Ontario, Canada.
  • Department of Epidemiology and Biostatistics, Western University, London, Ontario, Canada.
  • Department of Biostatistics, Epidemiology and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania.
  • Robarts Research Institute, Schulich School of Medicine & Dentistry, University of Western Ontario, London, Ontario, Canada.

ORCID profiles: Yun-Hee Choi, Leonardo Guizzetti, Di Shu, Guangyong Zou

Funding

  • Natural Sciences and Engineering Research Council of Canada

Cite

APA

Zou, L., Choi, Y. H., Guizzetti, L., Shu, D., Zou, J., & Zou, G. (2024). Extending the DeLong algorithm for comparing areas under correlated receiver operating characteristic curves with missing data. Statistics in Medicine, 43(21), 4148-4162. https://doi.org/10.1002/sim.10172

Vancouver

Zou L, Choi YH, Guizzetti L, Shu D, Zou J, Zou G. Extending the DeLong algorithm for comparing areas under correlated receiver operating characteristic curves with missing data. Statistics in Medicine. 2024;43(21):4148-4162. doi:10.1002/sim.10172

BibTeX
@article{Zou2024,
  author = {Zou, Lily and Choi, Yun-Hee and Guizzetti, Leonardo and Shu, Di and Zou, Joshua and Zou, Guangyong},
  title = {Extending the DeLong algorithm for comparing areas under correlated receiver operating characteristic curves with missing data},
  journal = {Statistics in Medicine},
  year = {2024},
  volume = {43},
  number = {21},
  pages = {4148--4162},
  doi = {10.1002/sim.10172}
}
Start for free →