EUVIMEDEUVIMED entdecken
ValidierungsstudieOpen Access · CC BY-NC-ND 4.0

Validation of a Risk‐Prediction Model in the Presence of Outcome Misclassification

Runjia Zou, Brian D Williamson iD, Susan M Shortreed, R Yates Coley iD

Statistics in Medicine · 2026-04 · 45 (8-9)

DOI: 10.1002/sim.70377 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift Statistics in Medicine, online erschienen am 03.04.2026. Verfasst von Runjia Zou und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biostatistics, University of Washington, Seattle, Washington, USA. Hauptthemen laut MEDLINE: Models, Statistical, Electronic Health Records. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NIMH NIH HHS, National Institute of Mental Health.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Electronic health records (EHRs) provide a rich data source for building prediction models to improve the quality of care. However, EHR data are prone to measurement error, and outcomes used to evaluate prediction model performance may be misclassified. Comparing risk predictions to misclassified outcomes will result in unreliable estimates of a prediction model's performance. We propose a method that leverages a smaller chart review sample with gold‐standard outcome measurements to adjust validation for outcome misclassification and provide more accurate prediction model evaluation. We derive formulae to estimate true positive rate (TPR), false positive rate (FPR), positive predictive value (PPV), negative predictive value (NPV), and area under the receiver operating characteristic curve (AUC) in the presence of outcome misclassification. Different scenarios of misclassification are explored, including when the misclassification is independent or dependent on features, and when misclassification is unidirectional (e.g., only missed diagnoses) or bidirectional. In simulation studies, we compare the bias and 95% confidence interval coverage of performance estimates obtained using our proposed method to those estimated with misclassified outcomes (without accounting for misclassification) or in the smaller chart review sample. Simulation results indicate that, across all misclassification scenarios examined, our proposed estimates have good accuracy and improved precision. Outcome misclassification should be considered when evaluating a prediction model's performance in order to accurately inform decision‐making about whether and how to use a clinical prediction model.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Models, StatisticalElectronic Health RecordsHumansPrediction AlgorithmsComputer SimulationROC CurveArea Under CurveBiasRisk AssessmentPredictive Value of TestsPredictive Learning Models

Stichwörter der Autor:innen

ROC curveclassification accuracyclinical prediction modelmachine learningmeasurement error

Autor:innen und Institutionen

  • Department of Biostatistics, University of Washington, Seattle, Washington, USA.
  • Biostatistics Division, Kaiser Permanente Washington Health Research Institute, Seattle, Washington, USA.
  • Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Center, Seattle, Washington, USA.
  • Department of Health Systems and Population Health, University of Washington, Seattle, Washington, USA.

ORCID-Profile: Brian D Williamson, R Yates Coley

Förderung

  • NIMH NIH HHS
  • National Institute of Mental Health

Zitieren

APA

Zou, R., D Williamson, B., M Shortreed, S., & Coley, R. Y. (2026). Validation of a Risk‐Prediction Model in the Presence of Outcome Misclassification. Statistics in Medicine, 45(8-9). https://doi.org/10.1002/sim.70377

Vancouver

Zou R, D Williamson B, M Shortreed S, Coley RY. Validation of a Risk‐Prediction Model in the Presence of Outcome Misclassification. Statistics in Medicine. 2026;45(8-9). doi:10.1002/sim.70377

BibTeX
@article{Zou2026,
  author = {Zou, Runjia and D Williamson, Brian and M Shortreed, Susan and Coley, R Yates},
  title = {Validation of a Risk‐Prediction Model in the Presence of Outcome Misclassification},
  journal = {Statistics in Medicine},
  year = {2026},
  volume = {45},
  number = {8-9},
  doi = {10.1002/sim.70377}
}
Kostenlos starten →