Inconsistent consistency: evaluating the well-defined intervention assumption in applied epidemiological research
International Journal of Epidemiology · 2025
DOI: 10.1093/ije/dyaf015 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift International Journal of Epidemiology, 2025. Verfasst von Jerzy Eisenberg-Guyot und 3 weiteren Autor:innen. Beteiligte Einrichtung: Division of Epidemiology, NYU Grossman School of Medicine, New York, NY, USA. Hauptthemen laut MEDLINE: Causality, Epidemiologic Studies, Epidemiologic Research Design. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: National Institute of Mental Health of the National Institutes of Health, NIA NIH HHS, National Institute of Aging of the National Institutes of Health.
Abstract (Originalsprache)
Background
According to textbook guidance, satisfying the well-defined intervention assumption is key for estimating causal effects. However, no studies have systematically evaluated how the assumption is addressed in research. Thus, we reviewed how researchers using g-methods or targeted maximum likelihood estimation (TMLE) interpreted and addressed the well-defined intervention assumption in epidemiological studies.
Methods
We reviewed observational epidemiological studies that used g-methods or TMLE, were published from 2000–21 in epidemiology journals with the six highest 2020 impact factors and met additional criteria. Among other factors, reviewers assessed if authors of included studies aimed to estimate the effects of hypothetical interventions. Then, among such studies, reviewers assessed whether authors discussed key causal-inference assumptions (e.g. consistency or treatment variation irrelevance), how they interpreted their findings and if they specified well-defined interventions.
Results
Just 20% (29/146) of studies aimed to estimate the effects of hypothetical interventions. Of such intervention-effect studies, almost none (1/29) stated ‘how’ the exposure would be intervened upon; among those that did not state a ‘how’, the ‘how’ mattered for consistency (i.e., for treatment variation irrelevance) in 64% of studies (18/28). Moreover, whereas 79% (23/29) of intervention-effect studies mentioned consistency, just 45% (13/29) interpreted findings as corresponding to the effects of hypothetical interventions. Finally, reviewers determined that just 38% (11/29) of intervention-effect studies had well-defined interventions.
Conclusions
We found substantial deviations between guidelines regarding meeting the well-defined intervention assumption and researchers’ application of the guidelines, with authors of intervention-effect studies rarely critically examining the assumption’s validity, let alone specifying well-defined interventions.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Epidemiology, NYU Grossman School of Medicine, New York, NY, USA.
- Department of Epidemiology, Mailman School of Public Health, Columbia University, New York, NY, USA.
- Department of Sociomedical Sciences, Mailman School of Public Health, Columbia University, New York, NY, USA.
ORCID-Profile: Jerzy Eisenberg-Guyot, Katrina L Kezios
Förderung
- National Institute of Mental Health of the National Institutes of Health
- NIA NIH HHS
- National Institute of Aging of the National Institutes of Health
- NIMH NIH HHS
- NIH
Zitieren
APA
Eisenberg-Guyot, J., Kezios, K. L., Prins, S. J., & Schwartz, S. (2025). Inconsistent consistency: evaluating the well-defined intervention assumption in applied epidemiological research. International Journal of Epidemiology. https://doi.org/10.1093/ije/dyaf015
Vancouver
Eisenberg-Guyot J, Kezios KL, Prins SJ, Schwartz S. Inconsistent consistency: evaluating the well-defined intervention assumption in applied epidemiological research. International Journal of Epidemiology. 2025. doi:10.1093/ije/dyaf015
BibTeX
@article{EisenbergGuyot2025,
author = {Eisenberg-Guyot, Jerzy and Kezios, Katrina L and Prins, Seth J and Schwartz, Sharon},
title = {Inconsistent consistency: evaluating the well-defined intervention assumption in applied epidemiological research},
journal = {International Journal of Epidemiology},
year = {2025},
doi = {10.1093/ije/dyaf015}
}
EUVIMED