Assessing Treatment Effects in Observational Data With Missing Confounders: A Comparative Study of Practical Doubly‐Robust and Traditional Missing Data Methods
Statistics in Medicine · 2026
DOI: 10.1002/sim.70366 ↗At a glance
Vergleichsstudie in Statistics in Medicine, 2026. Written by Brian D Williamson and 15 co-authors. Institution: Biostatistics Division, Kaiser Permanente Washington Health Research Institute, Seattle, Washington, USA. Major MEDLINE topics: Observational Studies as Topic. Cited 7 times so far (Crossref); 68 references. The full text is freely available in PubMed Central. Funded by: NIAID NIH HHS, U.S. Food and Drug Administration, NIH HHS.
Abstract (original language)
In pharmacoepidemiology, safety and effectiveness are frequently evaluated using readily available administrative and electronic health records data. In these settings, detailed confounder data are often not available in all data sources and therefore missing on a subset of individuals. Multiple imputation (MI) and inverse‐probability weighting (IPW) are go‐to analytical methods to handle missing data and are dominant in the biomedical literature. Doubly‐robust methods, which are consistent under fewer assumptions, can be more efficient with respect to mean‐squared error. We discuss two practical‐to‐implement doubly‐robust estimators, generalized raking and inverse probability‐weighted targeted maximum likelihood estimation (TMLE), which are both currently under‐utilized in biomedical studies. We compare their performance to IPW and MI in a detailed numerical study for a variety of synthetic data‐generating and missingness scenarios, including scenarios with rare outcomes and a high missingness proportion. Further, we consider plasmode simulation studies that emulate the complex data structure of a large electronic health records cohort in order to compare anti‐depressant therapies in a rare‐outcome setting where a key confounder is prone to more than 50% missingness. We provide guidance on selecting a missing data analysis approach, based on which methods excelled with respect to the bias‐variance trade‐off across the different scenarios studied.
Subjects
MeSH terms (MEDLINE)
Substances
Authors and institutions
- Biostatistics Division, Kaiser Permanente Washington Health Research Institute, Seattle, Washington, USA.
- Department of Biostatistics, University of Washington, Seattle, Washington, USA.
- TL Revolution, LLC, Cambridge, Massachusetts, USA.
- Department of Biostatistics, Vanderbilt University, Nashville, Tennessee, USA.
- Department of Biostatistics, School of Public Health, University of California at Berkeley, Berkeley, California, USA.
- Department of Statistics, University of Auckland, Auckland, New Zealand.
ORCID profiles: Brian D Williamson, Hana Lee, Pamela A Shaw
Funding
- NIAID NIH HHS
- U.S. Food and Drug Administration
- NIH HHS
- National Institutes of Health
Cite
APA
Williamson, B. D., Krakauer, C., Johnson, E., Gruber, S., Shepherd, B. E., van der Laan, M. J., Lumley, T., Lee, H., Hernández-Muñoz, J. J., Zhao, F., Dutcher, S. K., Desai, R., Simon, G. E., Shortreed, S. M., Nelson, J. C., & Shaw, P. A. (2026). Assessing Treatment Effects in Observational Data With Missing Confounders: A Comparative Study of Practical Doubly‐Robust and Traditional Missing Data Methods. Statistics in Medicine. https://doi.org/10.1002/sim.70366
Vancouver
Williamson BD, Krakauer C, Johnson E, Gruber S, Shepherd BE, van der Laan MJ, et al. Assessing Treatment Effects in Observational Data With Missing Confounders: A Comparative Study of Practical Doubly‐Robust and Traditional Missing Data Methods. Statistics in Medicine. 2026. doi:10.1002/sim.70366
BibTeX
@article{Williamson2026,
author = {Williamson, Brian D and Krakauer, Chloe and Johnson, Eric and Gruber, Susan and Shepherd, Bryan E and van der Laan, Mark J and Lumley, Thomas and Lee, Hana and Hernández-Muñoz, José J and Zhao, Fengyu and Dutcher, Sarah K and Desai, Rishi and Simon, Gregory E and Shortreed, Susan M and Nelson, Jennifer C and Shaw, Pamela A},
title = {Assessing Treatment Effects in Observational Data With Missing Confounders: A Comparative Study of Practical Doubly‐Robust and Traditional Missing Data Methods},
journal = {Statistics in Medicine},
year = {2026},
doi = {10.1002/sim.70366}
}
EUVIMED