EUVIMEDOntdek EUVIMED
Crossref

Expected Value of Sample Information Calculations for Risk Prediction Model Development

Abdollah Safari, Paul Gustafson iD, Mohsen Sadatsafavi

Statistics in Medicine · 2026-04 · 45 (8-9)

DOI: 10.1002/sim.70484 ↗

At a glance

Journal article in Statistics in Medicine, published online on 2026-04-13. Written by Abdollah Safari and 2 co-authors. Institution: School of Mathematics, Statistics, and Computer Science, Faculty of Science, University of Tehran, Tehran, Iran. Major MEDLINE topics: Models, Statistical. Cited 1 times so far (Crossref); 36 references.

SamenvattingSubjectsBibliografische gegevensCiteRelated studies

Abstract (original language)

Risk prediction models are often advertised as deterministic functions that map covariates to predicted risks. However, they are typically trained using finite samples, and as such, their predictions are inherently uncertain. This uncertainty has been addressed in terms of uncertainty around metrics of model performance (e.g., confidence interval around c ‐statistic), as well as uncertainty or instability of predictions. Correspondingly, sample size calculations for model development studies target the precision of estimates of summary statistics and the stability of predictions. However, when evaluating the clinical utility of a model (as in net benefit [NB] calculations in decision curve analysis), statistical inference is less relevant. From a decision‐theoretic perspective, the finite size of the sample results in utility loss due to the discrepancy between the fitted model and the correct model. From this perspective, procuring more development data is associated with an expected gain in the utility of using the model. In this work, we define the Expected Value of Sample Information (EVSI) as the expected gain in clinical utility, defined in NB terms, by procuring an additional development sample of a given size. We propose a bootstrap‐based algorithm for EVSI computations and demonstrate its feasibility and face validity in a case study. We conclude that decision‐theoretic metrics can complement classical inferential methods when designing studies aimed at developing risk prediction models.

Subjects

MeSH terms (MEDLINE)

Models, StatisticalHumansRisk AssessmentPrediction AlgorithmsAlgorithmsSample SizeDecision Support TechniquesUncertaintyComputer Simulation

Author keywords

Bayesian statisticsdecision theoryprecision medicinepredictive analyticsvalue of information

Authors and institutions

  • School of Mathematics, Statistics, and Computer Science, Faculty of Science, University of Tehran, Tehran, Iran.
  • Department of Statistics, University of British Columbia, Vancouver, British Columbia, Canada.
  • Respiratory Evaluation Sciences Program, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada.

ORCID profiles: Paul Gustafson

Cite

APA

Safari, A., Gustafson, P., & Sadatsafavi, M. (2026). Expected Value of Sample Information Calculations for Risk Prediction Model Development. Statistics in Medicine, 45(8-9). https://doi.org/10.1002/sim.70484

Vancouver

Safari A, Gustafson P, Sadatsafavi M. Expected Value of Sample Information Calculations for Risk Prediction Model Development. Statistics in Medicine. 2026;45(8-9). doi:10.1002/sim.70484

BibTeX
@article{Safari2026,
  author = {Safari, Abdollah and Gustafson, Paul and Sadatsafavi, Mohsen},
  title = {Expected Value of Sample Information Calculations for Risk Prediction Model Development},
  journal = {Statistics in Medicine},
  year = {2026},
  volume = {45},
  number = {8-9},
  doi = {10.1002/sim.70484}
}
Start for free →