Methods to Adjust for Confounding in Test-Negative Design COVID-19 Effectiveness Studies: Simulation Study
JMIR Formative Research · 2025
DOI: 10.2196/58981 ↗Kurz gefasst
Fachartikel in der Zeitschrift JMIR Formative Research, 2025. Verfasst von Elizabeth Ak Rowley und 17 weiteren Autor:innen. Beteiligte Einrichtung: Westat, Rockville, MD, United States. Hauptthemen laut MEDLINE: COVID-19, COVID-19 Vaccines, Vaccine Efficacy, Research Design. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Real-world COVID-19 vaccine effectiveness (VE) studies are investigating exposures of increasing complexity accounting for time since vaccination. These studies require methods that adjust for the confounding that arises when morbidities and demographics are associated with vaccination and the risk of outcome events. Methods based on propensity scores (PS) are well-suited to this when the exposure is dichotomous, but present challenges when the exposure is multinomial.
Objective
This simulation study aimed to investigate alternative methods to adjust for confounding in VE studies that have a test-negative design.
Methods
Adjustment for a disease risk score (DRS) is compared with multivariable logistic regression. Both stratification on the DRS and direct covariate adjustment of the DRS are examined. Multivariable logistic regression with all the covariates and with a limited subset of key covariates is considered. The performance of VE estimators is evaluated across a multinomial vaccination exposure in simulated datasets.
Results
Bias in VE estimates from multivariable models ranged from –5.3% to 6.1% across 4 levels of vaccination. Standard errors of VE estimates were unbiased, and 95% coverage probabilities were attained in most scenarios. The lowest coverage in the multivariable scenarios was 93.7% (95% CI 92.2%-95.2%) and occurred in the multivariable model with key covariates, while the highest coverage in the multivariable scenarios was 95.3% (95% CI 94.0%-96.6%) and occurred in the multivariable model with all covariates. Bias in VE estimates from DRS-adjusted models was low, ranging from –2.2% to 4.2%. However, the DRS-adjusted models underestimated the standard errors of VE estimates, with coverage sometimes below the 95% level. The lowest coverage in the DRS scenarios was 87.8% (95% CI 85.8%-89.8%) and occurred in the direct adjustment for the DRS model. The highest coverage in the DRS scenarios was 94.8% (95% CI 93.4%-96.2%) and occurred in the model that stratified on DRS. Although variation in the performance of VE estimates occurred across modeling strategies, variation in performance was also present across exposure groups.
Conclusions
Overall, models using a DRS to adjust for confounding performed adequately but not as well as the multivariable models that adjusted for covariates individually.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Westat, Rockville, MD, United States.
- Vaccine Study Center, Northern California Division of Research, Kaiser Permanente, Oakland, CA, United States.
- Center for Biomedical Informatics, Regenstrief Institute, Indianapolis, IN, United States.
- Fairbanks School of Public Health, Indiana University, Indianapolis, IN, United States.
- HealthPartners Institute, Minneapolis, MN, United States.
- Center for Health Research, Kaiser Permanente, Portland, OR, United States.
ORCID-Profile: Elizabeth Ak Rowley, Patrick K Mitchell, Duck-Hye Yang, Ned Lewis, Brian E Dixon, Gabriela Vazquez-Benitez, William F Fadel, Inih J Essien, Allison L Naleway, Edward Stenehjem, Toan C Ong, Manjusha Gaglani, Karthik Natarajan, Peter Embi, Ryan E Wiegand, Ruth Link-Gelles, Mark W Tenforde, Bruce Fireman
Zitieren
APA
Rowley, E. A., Mitchell, P. K., Yang, D. H., Lewis, N., Dixon, B. E., Vazquez-Benitez, G., Fadel, W. F., Essien, I. J., Naleway, A. L., Stenehjem, E., Ong, T. C., Gaglani, M., Natarajan, K., Embi, P., Wiegand, R. E., Link-Gelles, R., Tenforde, M. W., & Fireman, B. (2025). Methods to Adjust for Confounding in Test-Negative Design COVID-19 Effectiveness Studies: Simulation Study. JMIR Formative Research. https://doi.org/10.2196/58981
Vancouver
Rowley EA, Mitchell PK, Yang DH, Lewis N, Dixon BE, Vazquez-Benitez G, et al. Methods to Adjust for Confounding in Test-Negative Design COVID-19 Effectiveness Studies: Simulation Study. JMIR Formative Research. 2025. doi:10.2196/58981
BibTeX
@article{Rowley2025,
author = {Rowley, Elizabeth Ak and Mitchell, Patrick K and Yang, Duck-Hye and Lewis, Ned and Dixon, Brian E and Vazquez-Benitez, Gabriela and Fadel, William F and Essien, Inih J and Naleway, Allison L and Stenehjem, Edward and Ong, Toan C and Gaglani, Manjusha and Natarajan, Karthik and Embi, Peter and Wiegand, Ryan E and Link-Gelles, Ruth and Tenforde, Mark W and Fireman, Bruce},
title = {Methods to Adjust for Confounding in Test-Negative Design COVID-19 Effectiveness Studies: Simulation Study},
journal = {JMIR Formative Research},
year = {2025},
doi = {10.2196/58981}
}
EUVIMED