A Cautionary Note for Plasmode Simulation Studies in the Setting of Causal Inference
Statistics in Medicine · 2026-08 · 45 (18-19)
DOI: 10.1002/sim.70676 ↗Kurz gefasst
Fachartikel in der Zeitschrift Statistics in Medicine, online erschienen am 22.07.2026. Verfasst von Pamela A Shaw und 7 weiteren Autor:innen. Beteiligte Einrichtung: Biostatistics Division, Kaiser Permanente Washington Health Research Institute, Seattle, Washington, USA. Hauptthemen laut MEDLINE: Models, Statistical, Causality, Pharmacoepidemiology. Die Arbeit nennt 28 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIAID NIH HHS, U.S. Food and Drug Administration, National Institute of Allergy and Infectious Diseases.
Abstract (Originalsprache)
Plasmode simulation has become an important tool for evaluating operating characteristics of different statistical methods in complex settings, such as pharmacoepidemiological studies of treatment effectiveness using electronic health records (EHR) data. These studies provide insight into how estimator performance is impacted by challenges including rare events, small sample size and so forth that can indicate which among a set of methods performs best in a real‐world dataset. Plasmode simulation combines data resampled from a real‐world dataset with data from a probabilistic model to generate a known truth for an estimand in realistic data. There are different potential plasmode strategies currently in use. We compare two popular plasmode simulation frameworks for the evaluation of methods estimating a point treatment estimand. We provide numerical evidence and a theoretical result that shows one of these frameworks can cause certain estimators to incorrectly appear overly biased. Detailed simulation studies using both model‐generated and real‐world EHR data demonstrate these pitfalls remain at large sample sizes and when analyzing data from a randomized controlled trial. We conclude with guidance for the choice of a plasmode framework that maintains good theoretical properties to allow a fair evaluation of statistical methods while also maintaining the desired similarity to real data.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Biostatistics Division, Kaiser Permanente Washington Health Research Institute, Seattle, Washington, USA.
- Department of Biostatistics, University of Washington, Seattle, Washington, USA.
- TL Revolution, LLC, Cambridge, Massachusetts, USA.
- Division of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
- Department of Biostatistics, School of Public Health, University of California at Berkeley, Berkeley, California, USA.
ORCID-Profile: Pamela A Shaw, Brian D Williamson, Susan M Shortreed
Förderung
- NIAID NIH HHS
- U.S. Food and Drug Administration
- National Institute of Allergy and Infectious Diseases
Zitieren
APA
Shaw, P. A., Gruber, S., Williamson, B. D., Desai, R., Shortreed, S. M., Krakauer, C., Nelson, J. C., & van der Laan, M. J. (2026). A Cautionary Note for Plasmode Simulation Studies in the Setting of Causal Inference. Statistics in Medicine, 45(18-19). https://doi.org/10.1002/sim.70676
Vancouver
Shaw PA, Gruber S, Williamson BD, Desai R, Shortreed SM, Krakauer C, et al. A Cautionary Note for Plasmode Simulation Studies in the Setting of Causal Inference. Statistics in Medicine. 2026;45(18-19). doi:10.1002/sim.70676
BibTeX
@article{Shaw2026,
author = {Shaw, Pamela A and Gruber, Susan and Williamson, Brian D and Desai, Rishi and Shortreed, Susan M and Krakauer, Chloe and Nelson, Jennifer C and van der Laan, Mark J},
title = {A Cautionary Note for Plasmode Simulation Studies in the Setting of Causal Inference},
journal = {Statistics in Medicine},
year = {2026},
volume = {45},
number = {18-19},
doi = {10.1002/sim.70676}
}
EUVIMED