Comparative evaluation of methodologies for estimating the effectiveness of nonpharmaceutical interventions in the context of COVID-19: a simulation study
American Journal of Epidemiology · 2026
DOI: 10.1093/aje/kwaf035 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift American Journal of Epidemiology, 2026. Verfasst von Iris Ganser und 5 weiteren Autor:innen. Beteiligte Einrichtung: BPH Research Center, SISTM Team, Univ. Bordeaux, Inserm, UMR 1219, Bordeaux, France. Hauptthemen laut MEDLINE: COVID-19. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 38 Literaturangaben. Gefördert von: INSERM and the Investissements d'Avenir program, Vaccine Research Institute (VRI), managed by the ANR, French Agency for Research on AIDS and Emerging Infectious Diseases, Digital Public Health Graduate Program.
Abstract (Originalsprache)
Numerous studies assessing the effectiveness of nonpharmaceutical interventions (NPIs) against COVID-19 have produced conflicting results, partly due to methodological differences. This study aims to clarify these discrepancies by comparing 2 frequently used approaches in terms of parameter bias and CI coverage of NPI effectiveness parameters. We compared 2-step approaches, where NPI effects are regressed on by-products of the first analysis, such as the effective reproduction number ${\mathcal{R}}_t$, with more integrated models that jointly estimate NPI effects and transmission rates in a single-step approach. We simulated datasets with mechanistic and agent-based models and analyzed them with both mechanistic models and a 2-step regression procedure. In the latter, ${\mathcal{R}}_t$ was estimated first and then used as the outcome in a linear regression with NPI variables as predictors. Mechanistic models consistently outperformed 2-step regressions, exhibiting minimal bias (0%-5%) and accurate CI coverage. Conversely, the 2-step regression showed bias up to 25%, with significantly lower-than-nominal CI coverage, reflecting challenges in uncertainty propagation. We identified additional challenges in the 2-step regression method, such high depletion of susceptibles and time lags in observational data. Our findings suggest caution when using 2-step regression methods for estimating NPI effectiveness.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- BPH Research Center, SISTM Team, Univ. Bordeaux, Inserm, UMR 1219, Bordeaux, France.
- McGill Health Informatics, School of Population and Global Health, McGill University, Montreal, QC, Canada.
- Mathematical Modelling of Infectious Diseases Unit, Institut Pasteur, Paris, France.
- Infectious Diseases Department, Santé publique France, Saint Maurice, France.
- Inria, Inria Bordeaux - Sud-Ouest, Talence, France.
- Vaccine Research Institute, Creteil, France.
ORCID-Profile: Iris Ganser, Juliette Paireau, David L Buckeridge, Simon Cauchemez, Rodolphe Thiébaut, Mélanie Prague
Förderung
- INSERM and the Investissements d'Avenir program, Vaccine Research Institute (VRI), managed by the ANR
- French Agency for Research on AIDS and Emerging Infectious Diseases
- Digital Public Health Graduate Program
- INSERM and the Investissements d’Avenir program, Vaccine Research Institute (VRI), managed by the ANR
Zitieren
APA
Ganser, I., Paireau, J., Buckeridge, D. L., Cauchemez, S., Thiébaut, R., & Prague, M. (2026). Comparative evaluation of methodologies for estimating the effectiveness of nonpharmaceutical interventions in the context of COVID-19: a simulation study. American Journal of Epidemiology. https://doi.org/10.1093/aje/kwaf035
Vancouver
Ganser I, Paireau J, Buckeridge DL, Cauchemez S, Thiébaut R, Prague M. Comparative evaluation of methodologies for estimating the effectiveness of nonpharmaceutical interventions in the context of COVID-19: a simulation study. American Journal of Epidemiology. 2026. doi:10.1093/aje/kwaf035
BibTeX
@article{Ganser2026,
author = {Ganser, Iris and Paireau, Juliette and Buckeridge, David L and Cauchemez, Simon and Thiébaut, Rodolphe and Prague, Mélanie},
title = {Comparative evaluation of methodologies for estimating the effectiveness of nonpharmaceutical interventions in the context of COVID-19: a simulation study},
journal = {American Journal of Epidemiology},
year = {2026},
doi = {10.1093/aje/kwaf035}
}
EUVIMED