EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Comparing analytical strategies for balancing site-level characteristics in stepped-wedge cluster randomized trials: a simulation study

Clement Ma, Alina Lee, Darren Courtney, David Castle, Wei Wang

BMC Medical Research Methodology · 2023

DOI: 10.1186/s12874-023-02027-y ↗

Kurz gefasst

Fachartikel in der Zeitschrift BMC Medical Research Methodology, 2023. Verfasst von Clement Ma und 4 weiteren Autor:innen. Beteiligte Einrichtung: Biostatistics Core, Centre for Addiction and Mental Health, Toronto, ON, Canada. Hauptthemen laut MEDLINE: Benchmarking. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: CIHR.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Stepped-wedge cluster randomized trials (SWCRTs) are a type of cluster-randomized trial in which clusters are randomized to cross-over to the active intervention sequentially at regular intervals during the study period. For SWCRTs, sequential imbalances of cluster-level characteristics across the random sequence of clusters may lead to biased estimation. Our study aims to examine the effects of balancing cluster-level characteristics in SWCRTs.

Methods

To quantify the level of cluster-level imbalance, a novel imbalance index was developed based on the Spearman correlation and rank regression of the cluster-level characteristic with the cross-over timepoints. A simulation study was conducted to assess the impact of sequential cluster-level imbalances across different scenarios varying the: number of sites (clusters), sample size, number of cross-over timepoints, site-level intra-cluster correlation coefficient (ICC), and effect sizes. SWCRTs assumed either an immediate “constant” treatment effect, or a gradual “learning” treatment effect which increases over time after crossing over to the active intervention. Key performance metrics included the relative root mean square error (RRMSE) and relative mean bias.

Results

Fully-balanced designs almost always had the highest efficiency, as measured by the RRMSE, regardless of the number of sites, ICC, effect size, or sample sizes at each time for SWCRTs with learning effect. A consistent decreasing trend of efficiency was observed by increasing RRMSE as imbalance increased. For example, for a 12-site study with 20 participants per site/timepoint and ICC of 0.10, between the most balanced and least balanced designs, the RRMSE efficiency loss ranged from 52.5% to 191.9%. In addition, the RRMSE was decreased for larger sample sizes, larger number of sites, smaller ICC, and larger effect sizes. The impact of pre-balancing diminished when there was no learning effect.

Conclusion

The impact of pre-balancing on preventing efficiency loss was easily observed when there was a learning effect. This suggests benefit of pre-balancing with respect to impacting factors of treatment effects.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

BenchmarkingHumansRandomized Controlled Trials as TopicComputer SimulationSample Size

Stichwörter der Autor:innen

Cluster-level imbalanceSimulationStepped-wedge cluster randomized trials

Autor:innen und Institutionen

  • Biostatistics Core, Centre for Addiction and Mental Health, Toronto, ON, Canada.
  • Center for Complex Interventions, Centre for Addiction and Mental Health, Toronto, ON, Canada.
  • Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada.
  • Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, ON, Canada.
  • Department of Psychiatry, University of Toronto, Toronto, ON, Canada.
  • Department of Psychiatry, University of Tasmania, Hobart, TAS, Australia.

Förderung

  • CIHR

Zitieren

APA

Ma, C., Lee, A., Courtney, D., Castle, D., & Wang, W. (2023). Comparing analytical strategies for balancing site-level characteristics in stepped-wedge cluster randomized trials: a simulation study. BMC Medical Research Methodology. https://doi.org/10.1186/s12874-023-02027-y

Vancouver

Ma C, Lee A, Courtney D, Castle D, Wang W. Comparing analytical strategies for balancing site-level characteristics in stepped-wedge cluster randomized trials: a simulation study. BMC Medical Research Methodology. 2023. doi:10.1186/s12874-023-02027-y

BibTeX
@article{Ma2023,
  author = {Ma, Clement and Lee, Alina and Courtney, Darren and Castle, David and Wang, Wei},
  title = {Comparing analytical strategies for balancing site-level characteristics in stepped-wedge cluster randomized trials: a simulation study},
  journal = {BMC Medical Research Methodology},
  year = {2023},
  doi = {10.1186/s12874-023-02027-y}
}
Kostenlos starten →