A comparison of quasi-experimental methods with data before and after an intervention: an introduction for epidemiologists and a simulation study
International Journal of Epidemiology · 05.10.2023 · 52 (5) · 1522-1533
DOI: 10.1093/ije/dyad032 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift International Journal of Epidemiology, online erschienen am 06.04.2023. Verfasst von Roch A Nianogo und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Epidemiology, Fielding School of Public Health, University of California, Los Angeles (UCLA), Los Angeles, CA, USA. Hauptthemen laut MEDLINE: Epidemiologists, Research Design. Die Arbeit wurde bisher 55-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NIMHD NIH HHS, National Institute on Minority Health and Health Disparities, National Institutes of Health.
Abstract (Originalsprache)
Background
As the interest in and use of quasi-experimental methods to evaluate impacts of health policies have dramatically increased in the epidemiological literature, we set out this study to (i) systematically compare several quasi-experimental methods that use data before and after an intervention and contrast their performance within a simulation framework while providing a brief overview of the methods; and (ii) discuss challenges that could arise from using these methods as well as directions for future research in the context of epidemiological applications.
Methods
We considered single-group designs [pre-post and interrupted time series (ITS)] and multiple-group designs [controlled interrupted time series/difference-in-differences, synthetic control methods (SCMs): traditional SCMs and generalized SCMs]. We assessed performance based on bias and root mean squared error.
Results
We identified settings in which each method failed to provide unbiased estimates. We found that, among the methods investigated, when data for multiple time points and for multiple control groups are available (multiple-group designs), data-adaptive methods such as the generalized SCM were generally less biased than other methods evaluated in our study. In addition, when all of the included units have been exposed to treatment (single-group designs) and data for a sufficiently long pre-intervention period are available, then the ITS performs very well, provided the underlying model is correctly specified.
Conclusions
When using a quasi-experimental method using data before and after an intervention, epidemiologists should strive to use, whenever feasible, data-adaptive methods that nest alternative identifying assumptions including relaxing the parallel trend assumption (e.g. generalized SCMs).
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Epidemiology, Fielding School of Public Health, University of California, Los Angeles (UCLA), Los Angeles, CA, USA.
- California Center for Population Research, UCLA, Los Angeles, CA, USA.
- Scripps Institution of Oceanography, UC San Diego, La Jolla, CA, USA.
- Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK.
ORCID-Profile: Roch A Nianogo
Förderung
- NIMHD NIH HHS
- National Institute on Minority Health and Health Disparities
- National Institutes of Health
Zitieren
APA
Nianogo, R. A., Benmarhnia, T., & O'Neill, S. (2023). A comparison of quasi-experimental methods with data before and after an intervention: an introduction for epidemiologists and a simulation study. International Journal of Epidemiology, 52(5), 1522-1533. https://doi.org/10.1093/ije/dyad032
Vancouver
Nianogo RA, Benmarhnia T, O'Neill S. A comparison of quasi-experimental methods with data before and after an intervention: an introduction for epidemiologists and a simulation study. International Journal of Epidemiology. 2023;52(5):1522-1533. doi:10.1093/ije/dyad032
BibTeX
@article{Nianogo2023,
author = {Nianogo, Roch A and Benmarhnia, Tarik and O'Neill, Stephen},
title = {A comparison of quasi-experimental methods with data before and after an intervention: an introduction for epidemiologists and a simulation study},
journal = {International Journal of Epidemiology},
year = {2023},
volume = {52},
number = {5},
pages = {1522--1533},
doi = {10.1093/ije/dyad032}
}
EUVIMED