Expected Value of Sample Information Calculations for Risk Prediction Model Development
Statistics in Medicine · 2026-04 · 45 (8-9)
DOI: 10.1002/sim.70484 ↗Kurz gefasst
Fachartikel in der Zeitschrift Statistics in Medicine, online erschienen am 13.04.2026. Verfasst von Abdollah Safari und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Mathematics, Statistics, and Computer Science, Faculty of Science, University of Tehran, Tehran, Iran. Hauptthemen laut MEDLINE: Models, Statistical. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 36 Literaturangaben.
Abstract (Originalsprache)
Risk prediction models are often advertised as deterministic functions that map covariates to predicted risks. However, they are typically trained using finite samples, and as such, their predictions are inherently uncertain. This uncertainty has been addressed in terms of uncertainty around metrics of model performance (e.g., confidence interval around c ‐statistic), as well as uncertainty or instability of predictions. Correspondingly, sample size calculations for model development studies target the precision of estimates of summary statistics and the stability of predictions. However, when evaluating the clinical utility of a model (as in net benefit [NB] calculations in decision curve analysis), statistical inference is less relevant. From a decision‐theoretic perspective, the finite size of the sample results in utility loss due to the discrepancy between the fitted model and the correct model. From this perspective, procuring more development data is associated with an expected gain in the utility of using the model. In this work, we define the Expected Value of Sample Information (EVSI) as the expected gain in clinical utility, defined in NB terms, by procuring an additional development sample of a given size. We propose a bootstrap‐based algorithm for EVSI computations and demonstrate its feasibility and face validity in a case study. We conclude that decision‐theoretic metrics can complement classical inferential methods when designing studies aimed at developing risk prediction models.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Mathematics, Statistics, and Computer Science, Faculty of Science, University of Tehran, Tehran, Iran.
- Department of Statistics, University of British Columbia, Vancouver, British Columbia, Canada.
- Respiratory Evaluation Sciences Program, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada.
ORCID-Profile: Paul Gustafson
Zitieren
APA
Safari, A., Gustafson, P., & Sadatsafavi, M. (2026). Expected Value of Sample Information Calculations for Risk Prediction Model Development. Statistics in Medicine, 45(8-9). https://doi.org/10.1002/sim.70484
Vancouver
Safari A, Gustafson P, Sadatsafavi M. Expected Value of Sample Information Calculations for Risk Prediction Model Development. Statistics in Medicine. 2026;45(8-9). doi:10.1002/sim.70484
BibTeX
@article{Safari2026,
author = {Safari, Abdollah and Gustafson, Paul and Sadatsafavi, Mohsen},
title = {Expected Value of Sample Information Calculations for Risk Prediction Model Development},
journal = {Statistics in Medicine},
year = {2026},
volume = {45},
number = {8-9},
doi = {10.1002/sim.70484}
}
EUVIMED