EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access

Inconsistent consistency: evaluating the well-defined intervention assumption in applied epidemiological research

Jerzy Eisenberg-Guyot iD, Katrina L Kezios iD, Seth J Prins, Sharon Schwartz

International Journal of Epidemiology · 2025

DOI: 10.1093/ije/dyaf015 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift International Journal of Epidemiology, 2025. Verfasst von Jerzy Eisenberg-Guyot und 3 weiteren Autor:innen. Beteiligte Einrichtung: Division of Epidemiology, NYU Grossman School of Medicine, New York, NY, USA. Hauptthemen laut MEDLINE: Causality, Epidemiologic Studies, Epidemiologic Research Design. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: National Institute of Mental Health of the National Institutes of Health, NIA NIH HHS, National Institute of Aging of the National Institutes of Health.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

According to textbook guidance, satisfying the well-defined intervention assumption is key for estimating causal effects. However, no studies have systematically evaluated how the assumption is addressed in research. Thus, we reviewed how researchers using g-methods or targeted maximum likelihood estimation (TMLE) interpreted and addressed the well-defined intervention assumption in epidemiological studies.

Methods

We reviewed observational epidemiological studies that used g-methods or TMLE, were published from 2000–21 in epidemiology journals with the six highest 2020 impact factors and met additional criteria. Among other factors, reviewers assessed if authors of included studies aimed to estimate the effects of hypothetical interventions. Then, among such studies, reviewers assessed whether authors discussed key causal-inference assumptions (e.g. consistency or treatment variation irrelevance), how they interpreted their findings and if they specified well-defined interventions.

Results

Just 20% (29/146) of studies aimed to estimate the effects of hypothetical interventions. Of such intervention-effect studies, almost none (1/29) stated ‘how’ the exposure would be intervened upon; among those that did not state a ‘how’, the ‘how’ mattered for consistency (i.e., for treatment variation irrelevance) in 64% of studies (18/28). Moreover, whereas 79% (23/29) of intervention-effect studies mentioned consistency, just 45% (13/29) interpreted findings as corresponding to the effects of hypothetical interventions. Finally, reviewers determined that just 38% (11/29) of intervention-effect studies had well-defined interventions.

Conclusions

We found substantial deviations between guidelines regarding meeting the well-defined intervention assumption and researchers’ application of the guidelines, with authors of intervention-effect studies rarely critically examining the assumption’s validity, let alone specifying well-defined interventions.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

CausalityEpidemiologic StudiesEpidemiologic Research DesignHumansLikelihood FunctionsObservational Studies as TopicResearch Design

Stichwörter der Autor:innen

Consistencycausal inferencepotential outcomesstable unit treatment value assumptiontreatment variation irrelevancewell-defined intervention

Autor:innen und Institutionen

  • Division of Epidemiology, NYU Grossman School of Medicine, New York, NY, USA.
  • Department of Epidemiology, Mailman School of Public Health, Columbia University, New York, NY, USA.
  • Department of Sociomedical Sciences, Mailman School of Public Health, Columbia University, New York, NY, USA.

ORCID-Profile: Jerzy Eisenberg-Guyot, Katrina L Kezios

Förderung

  • National Institute of Mental Health of the National Institutes of Health
  • NIA NIH HHS
  • National Institute of Aging of the National Institutes of Health
  • NIMH NIH HHS
  • NIH

Zitieren

APA

Eisenberg-Guyot, J., Kezios, K. L., Prins, S. J., & Schwartz, S. (2025). Inconsistent consistency: evaluating the well-defined intervention assumption in applied epidemiological research. International Journal of Epidemiology. https://doi.org/10.1093/ije/dyaf015

Vancouver

Eisenberg-Guyot J, Kezios KL, Prins SJ, Schwartz S. Inconsistent consistency: evaluating the well-defined intervention assumption in applied epidemiological research. International Journal of Epidemiology. 2025. doi:10.1093/ije/dyaf015

BibTeX
@article{EisenbergGuyot2025,
  author = {Eisenberg-Guyot, Jerzy and Kezios, Katrina L and Prins, Seth J and Schwartz, Sharon},
  title = {Inconsistent consistency: evaluating the well-defined intervention assumption in applied epidemiological research},
  journal = {International Journal of Epidemiology},
  year = {2025},
  doi = {10.1093/ije/dyaf015}
}
Kostenlos starten →