EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Are We in Control? How Best to Include a Control Group in Interrupted Time Series Designs: A Simulation Study

Francesco Manca, Daniel Mackay, Jim Lewsey

Journal of Evaluation in Clinical Practice · 2026

DOI: 10.1111/jep.70466 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Evaluation in Clinical Practice, 2026. Verfasst von Francesco Manca und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Health and Wellbeing, University of Glasgow, Glasgow, Scotland. Hauptthemen laut MEDLINE: Interrupted Time Series Analysis, Models, Statistical, Control Groups. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 21 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Chief Scientist Office, Scottish Government Health and Social Care Directorate.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

While controlled interrupted time series (CITS) are commonly used to evaluate public health policies, how to incorporate control(s) into their statistical modelling has received limited attention. We aimed to compare the statistical performance of different model formulations for including control groups in various segmented regression model specifications (with a particular focus on CITS and Difference‐in‐Difference [DiD] designs) under conditions where their assumptions are met, as well as when they are violated.

Methods

Based on a real‐world dataset, we simulated and compared the statistical performance of four model formulations grounded on segmented regressions for including control groups in a pre‐ and post‐evaluation. The compared model formulations were: (1) CITS segmented regression, (2) DiD segmented regression, (3) single ITS of the difference between control and intervention series, and (4) incorporating the control as a covariate in a single ITS. Models were tested across scenarios challenging assumptions around the control group (e.g., non‐parallel trends ‐challenging DiD assumptions‐, or inconsistent trend difference over time between groups ‐challenging CITS assumption‐) or regression errors (e.g., heteroscedasticity or autocorrelation). We also included models, including restricted cubic splines of time, which may mitigate distortions from assumption violations. Additionally, we tested for detecting non‐parallel trends.

Results

Standard DiD, CITS, and the ITS of the difference between series yielded the lowest bias whenever their design assumptions were satisfied. Overall, including time splines as covariates into ITS of the difference between series achieved the lowest bias and highest coverage also when design assumptions were violated. This makes it a valuable tool for causal inference in settings with parallel, non‐parallel or inconsistent trend patterns between groups. Since violations of the trends assumption are often undetectable, methods robust to such violations are extremely valuable.

Conclusions

Modelling CITS as an ITS of the difference between series is among the most robust methods to embed control series into model specifications. Incorporating time splines as model covariates within an ITS of the difference has the potential of reducing bias from assumption violations (including parallel trends) without negative impacts when assumptions hold.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Interrupted Time Series AnalysisModels, StatisticalControl GroupsHumansComputer SimulationRegression AnalysisResearch Design

Stichwörter der Autor:innen

autocorrelationcontrolled interrupted time seriesinterrupted time seriesparallel trendsimulation studiesspline

Autor:innen und Institutionen

  • School of Health and Wellbeing, University of Glasgow, Glasgow, Scotland.

Förderung

  • Chief Scientist Office, Scottish Government Health and Social Care Directorate

Zitieren

APA

Manca, F., Mackay, D., & Lewsey, J. (2026). Are We in Control? How Best to Include a Control Group in Interrupted Time Series Designs: A Simulation Study. Journal of Evaluation in Clinical Practice. https://doi.org/10.1111/jep.70466

Vancouver

Manca F, Mackay D, Lewsey J. Are We in Control? How Best to Include a Control Group in Interrupted Time Series Designs: A Simulation Study. Journal of Evaluation in Clinical Practice. 2026. doi:10.1111/jep.70466

BibTeX
@article{Manca2026,
  author = {Manca, Francesco and Mackay, Daniel and Lewsey, Jim},
  title = {Are We in Control? How Best to Include a Control Group in Interrupted Time Series Designs: A Simulation Study},
  journal = {Journal of Evaluation in Clinical Practice},
  year = {2026},
  doi = {10.1111/jep.70466}
}
Kostenlos starten →