Assessing the performance of methods for central statistical monitoring of a binary or continuous outcome in multi-center trials: A simulation study
Contemporary Clinical Trials · 2024
DOI: 10.1016/j.cct.2024.107580 ↗Kurz gefasst
Fachartikel in der Zeitschrift Contemporary Clinical Trials, 2024. Verfasst von Li Ge und 5 weiteren Autor:innen. Beteiligte Einrichtung: Gilead Sciences, Foster City 94404, CA, USA; Department of Biostatistics and Medical Informatics, University of Wisconsin-Madison, Madison 53703, WI,…. Hauptthemen laut MEDLINE: Computer Simulation, Models, Statistical, Multicenter Studies as Topic, Area Under Curve. Die Arbeit nennt 48 Literaturangaben.
Abstract (Originalsprache)
BACKGROUND: Quality study monitoring is fundamental to patient safety and data integrity. Regulators and industry consortia have increasingly advocated for risk-based monitoring (RBM) and central statistical monitoring (CSM) for more effective and efficient monitoring. Assessing which statistical methods underpin these approaches can best identify unusual data patterns in multi-center clinical trials that may be driven by potential systematic errors is important. METHODS: We assessed various CSM techniques, including cross-tests, fixed-effects, mixed-effects, and finite mixture models, across scenarios with different sample sizes, contamination rates, and overdispersion via simulation. Our evaluation utilized threshold-independent metrics such as the area under the curve (AUC) and average precision (AP), offering a fuller picture of CSM performance. RESULTS: All CSM methods showed consistent characteristics across center sizes or overdispersion. The adaptive finite mixture model outperformed others in AUC and AP, especially at 30% contamination, upholding high specificity unless converging to a single-component model due to low contamination or deviation. The mixed-effects model performed well at lower contamination rates. However, it became conservative in specificity and exhibited declined performance for binary outcomes under high deviation. Cross-tests and fixed-effects methods underperformed, especially when deviation increased. CONCLUSION: Our evaluation explored the merits and drawbacks of multiple CSM methods, and found that relying on sensitivity and specificity alone is likely insufficient to fully measure predictive performance. The finite mixture method demonstrated more consistent performance across scenarios by mitigating the influence of outliers. In practice, considering the study-specific costs of false positives/negatives with available resources for monitoring is important.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Gilead Sciences, Foster City 94404, CA, USA; Department of Biostatistics and Medical Informatics, University of Wisconsin-Madison, Madison 53703, WI, USA.
- Gilead Sciences, Foster City 94404, CA, USA.
- Gilead Sciences, Foster City 94404, CA, USA. Electronic address: george.wu@gilead.com.
Zitieren
APA
Ge, L., Wang, Z., Liu, C. C., Childress, S., Wildfire, J., & Wu, G. (2024). Assessing the performance of methods for central statistical monitoring of a binary or continuous outcome in multi-center trials: A simulation study. Contemporary Clinical Trials. https://doi.org/10.1016/j.cct.2024.107580
Vancouver
Ge L, Wang Z, Liu CC, Childress S, Wildfire J, Wu G. Assessing the performance of methods for central statistical monitoring of a binary or continuous outcome in multi-center trials: A simulation study. Contemporary Clinical Trials. 2024. doi:10.1016/j.cct.2024.107580
BibTeX
@article{Ge2024,
author = {Ge, Li and Wang, Zhongkai and Liu, Charles C and Childress, Spencer and Wildfire, Jeremy and Wu, George},
title = {Assessing the performance of methods for central statistical monitoring of a binary or continuous outcome in multi-center trials: A simulation study},
journal = {Contemporary Clinical Trials},
year = {2024},
doi = {10.1016/j.cct.2024.107580}
}
EUVIMED