Validation of a Risk‐Prediction Model in the Presence of Outcome Misclassification
Statistics in Medicine · 2026-04 · 45 (8-9)
DOI: 10.1002/sim.70377 ↗Kurz gefasst
Validierungsstudie in der Zeitschrift Statistics in Medicine, online erschienen am 03.04.2026. Verfasst von Runjia Zou und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biostatistics, University of Washington, Seattle, Washington, USA. Hauptthemen laut MEDLINE: Models, Statistical, Electronic Health Records. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NIMH NIH HHS, National Institute of Mental Health.
Abstract (Originalsprache)
Electronic health records (EHRs) provide a rich data source for building prediction models to improve the quality of care. However, EHR data are prone to measurement error, and outcomes used to evaluate prediction model performance may be misclassified. Comparing risk predictions to misclassified outcomes will result in unreliable estimates of a prediction model's performance. We propose a method that leverages a smaller chart review sample with gold‐standard outcome measurements to adjust validation for outcome misclassification and provide more accurate prediction model evaluation. We derive formulae to estimate true positive rate (TPR), false positive rate (FPR), positive predictive value (PPV), negative predictive value (NPV), and area under the receiver operating characteristic curve (AUC) in the presence of outcome misclassification. Different scenarios of misclassification are explored, including when the misclassification is independent or dependent on features, and when misclassification is unidirectional (e.g., only missed diagnoses) or bidirectional. In simulation studies, we compare the bias and 95% confidence interval coverage of performance estimates obtained using our proposed method to those estimated with misclassified outcomes (without accounting for misclassification) or in the smaller chart review sample. Simulation results indicate that, across all misclassification scenarios examined, our proposed estimates have good accuracy and improved precision. Outcome misclassification should be considered when evaluating a prediction model's performance in order to accurately inform decision‐making about whether and how to use a clinical prediction model.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biostatistics, University of Washington, Seattle, Washington, USA.
- Biostatistics Division, Kaiser Permanente Washington Health Research Institute, Seattle, Washington, USA.
- Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Center, Seattle, Washington, USA.
- Department of Health Systems and Population Health, University of Washington, Seattle, Washington, USA.
ORCID-Profile: Brian D Williamson, R Yates Coley
Förderung
- NIMH NIH HHS
- National Institute of Mental Health
Zitieren
APA
Zou, R., D Williamson, B., M Shortreed, S., & Coley, R. Y. (2026). Validation of a Risk‐Prediction Model in the Presence of Outcome Misclassification. Statistics in Medicine, 45(8-9). https://doi.org/10.1002/sim.70377
Vancouver
Zou R, D Williamson B, M Shortreed S, Coley RY. Validation of a Risk‐Prediction Model in the Presence of Outcome Misclassification. Statistics in Medicine. 2026;45(8-9). doi:10.1002/sim.70377
BibTeX
@article{Zou2026,
author = {Zou, Runjia and D Williamson, Brian and M Shortreed, Susan and Coley, R Yates},
title = {Validation of a Risk‐Prediction Model in the Presence of Outcome Misclassification},
journal = {Statistics in Medicine},
year = {2026},
volume = {45},
number = {8-9},
doi = {10.1002/sim.70377}
}
EUVIMED