Improving Variance and Confidence Interval Estimation in Small‐Sample Propensity Score Analyses: Bootstrap Versus Asymptotic Methods
Statistics in Medicine · 2026-07 · 45 (15-17)
DOI: 10.1002/sim.70643 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Statistics in Medicine, online erschienen am 23.06.2026. Verfasst von Baoshan Zhang und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina, USA. Hauptthemen laut MEDLINE: Propensity Score. Die Arbeit nennt 29 Literaturangaben. Gefördert von: Burroughs Wellcome Fund, PCORI, Patient-Centered Outcomes Research Institute.
Abstract (Originalsprache)
Propensity score (PS) methods are widely used to estimate treatment effects in non‐randomized studies. Variance is typically estimated using sandwich or bootstrap methods, which can either treat the PS as estimated or fixed. The latter is thought to be conservative. Comparisons between sandwich and bootstrap estimators have been made in moderate to large sample sizes, favoring the bootstrap estimator. With the growing interest in treatments for rare diseases and externally controlled clinical trials, very small sample sizes are not uncommon and the asymptotic properties of sandwich estimators may not hold. Bootstrap methods that allow for PS re‐estimation can also generate problems with quasi‐separation in small samples. It is unclear whether it is safe to prefer sandwich estimators or to assume that treating the PS as fixed is conservative. We conducted a Monte Carlo simulation to compare the performance of bootstrap versus sandwich variance and CI estimators for average treatment effects estimated with PS methods. We systematically evaluated the impact of treating the PS as fixed versus re‐estimating it. These methodological comparisons were performed using inverse probability of treatment weighting (IPTW) and augmented inverse probability of treatment weighting (AIPW) estimators. Simulations assessed performance under various conditions, including small sample sizes and different outcome and treatment prevalences. We illustrate the differences in our motivating example, the LIMIT‐JIA trial. We show that the sandwich estimators can perform quite poorly in small samples, and fixed PS methods are not necessarily conservative. A stratified bootstrap avoids quasi‐separation and performs well. Differences were large enough to alter statistical conclusions in our motivating example, LIMIT‐JIA.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina, USA.
- Duke Clinical Research Institute, Duke University Medical Center, Durham, North Carolina, USA.
ORCID-Profile: Baoshan Zhang, Laine E Thomas
Förderung
- Burroughs Wellcome Fund
- PCORI
- Patient-Centered Outcomes Research Institute
Zitieren
APA
Zhang, B., O'Brien, S. M., Wu, Y., & Thomas, L. E. (2026). Improving Variance and Confidence Interval Estimation in Small‐Sample Propensity Score Analyses: Bootstrap Versus Asymptotic Methods. Statistics in Medicine, 45(15-17). https://doi.org/10.1002/sim.70643
Vancouver
Zhang B, O'Brien SM, Wu Y, Thomas LE. Improving Variance and Confidence Interval Estimation in Small‐Sample Propensity Score Analyses: Bootstrap Versus Asymptotic Methods. Statistics in Medicine. 2026;45(15-17). doi:10.1002/sim.70643
BibTeX
@article{Zhang2026,
author = {Zhang, Baoshan and O'Brien, Sean M and Wu, Yuan and Thomas, Laine E},
title = {Improving Variance and Confidence Interval Estimation in Small‐Sample Propensity Score Analyses: Bootstrap Versus Asymptotic Methods},
journal = {Statistics in Medicine},
year = {2026},
volume = {45},
number = {15-17},
doi = {10.1002/sim.70643}
}
EUVIMED