Comparing analytical strategies for balancing site-level characteristics in stepped-wedge cluster randomized trials: a simulation study
BMC Medical Research Methodology · 2023
DOI: 10.1186/s12874-023-02027-y ↗Kurz gefasst
Fachartikel in der Zeitschrift BMC Medical Research Methodology, 2023. Verfasst von Clement Ma und 4 weiteren Autor:innen. Beteiligte Einrichtung: Biostatistics Core, Centre for Addiction and Mental Health, Toronto, ON, Canada. Hauptthemen laut MEDLINE: Benchmarking. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: CIHR.
Abstract (Originalsprache)
Background
Stepped-wedge cluster randomized trials (SWCRTs) are a type of cluster-randomized trial in which clusters are randomized to cross-over to the active intervention sequentially at regular intervals during the study period. For SWCRTs, sequential imbalances of cluster-level characteristics across the random sequence of clusters may lead to biased estimation. Our study aims to examine the effects of balancing cluster-level characteristics in SWCRTs.
Methods
To quantify the level of cluster-level imbalance, a novel imbalance index was developed based on the Spearman correlation and rank regression of the cluster-level characteristic with the cross-over timepoints. A simulation study was conducted to assess the impact of sequential cluster-level imbalances across different scenarios varying the: number of sites (clusters), sample size, number of cross-over timepoints, site-level intra-cluster correlation coefficient (ICC), and effect sizes. SWCRTs assumed either an immediate “constant” treatment effect, or a gradual “learning” treatment effect which increases over time after crossing over to the active intervention. Key performance metrics included the relative root mean square error (RRMSE) and relative mean bias.
Results
Fully-balanced designs almost always had the highest efficiency, as measured by the RRMSE, regardless of the number of sites, ICC, effect size, or sample sizes at each time for SWCRTs with learning effect. A consistent decreasing trend of efficiency was observed by increasing RRMSE as imbalance increased. For example, for a 12-site study with 20 participants per site/timepoint and ICC of 0.10, between the most balanced and least balanced designs, the RRMSE efficiency loss ranged from 52.5% to 191.9%. In addition, the RRMSE was decreased for larger sample sizes, larger number of sites, smaller ICC, and larger effect sizes. The impact of pre-balancing diminished when there was no learning effect.
Conclusion
The impact of pre-balancing on preventing efficiency loss was easily observed when there was a learning effect. This suggests benefit of pre-balancing with respect to impacting factors of treatment effects.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Biostatistics Core, Centre for Addiction and Mental Health, Toronto, ON, Canada.
- Center for Complex Interventions, Centre for Addiction and Mental Health, Toronto, ON, Canada.
- Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada.
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, ON, Canada.
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada.
- Department of Psychiatry, University of Tasmania, Hobart, TAS, Australia.
Förderung
- CIHR
Zitieren
APA
Ma, C., Lee, A., Courtney, D., Castle, D., & Wang, W. (2023). Comparing analytical strategies for balancing site-level characteristics in stepped-wedge cluster randomized trials: a simulation study. BMC Medical Research Methodology. https://doi.org/10.1186/s12874-023-02027-y
Vancouver
Ma C, Lee A, Courtney D, Castle D, Wang W. Comparing analytical strategies for balancing site-level characteristics in stepped-wedge cluster randomized trials: a simulation study. BMC Medical Research Methodology. 2023. doi:10.1186/s12874-023-02027-y
BibTeX
@article{Ma2023,
author = {Ma, Clement and Lee, Alina and Courtney, Darren and Castle, David and Wang, Wei},
title = {Comparing analytical strategies for balancing site-level characteristics in stepped-wedge cluster randomized trials: a simulation study},
journal = {BMC Medical Research Methodology},
year = {2023},
doi = {10.1186/s12874-023-02027-y}
}
EUVIMED