A re‐analysis of about 60,000 sparse data meta‐analyses suggests that using an adequate method for pooling matters
Research Synthesis Methods · 2024-11 · 15 (6) · 978-987
DOI: 10.1002/jrsm.1748 ↗Kurz gefasst
Fachartikel in der Zeitschrift Research Synthesis Methods, online erschienen am 13.08.2024. Verfasst von Maxi Schulz und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany. Hauptthemen laut MEDLINE: Bayes Theorem, Meta-Analysis as Topic, Models, Statistical, Algorithms. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In sparse data meta‐analyses (with few trials or zero events), conventional methods may distort results. Although better‐performing one‐stage methods have become available in recent years, their implementation remains limited in practice. This study examines the impact of using conventional methods compared to one‐stage models by re‐analysing meta‐analyses from the Cochrane Database of Systematic Reviews in scenarios with zero event trials and few trials. For each scenario, we computed one‐stage methods (Generalised linear mixed model [GLMM], Beta‐binomial model [BBM], Bayesian binomial‐normal hierarchical model using a weakly informative prior [BNHM‐WIP]) and compared them with conventional methods (Peto‐Odds‐ratio [PETO], DerSimonian‐Laird method [DL] for zero event trials; DL, Paule‐Mandel [PM], Restricted maximum likelihood [REML] method for few trials). While all methods showed similar treatment effect estimates, substantial variability in statistical precision emerged. Conventional methods generally resulted in smaller confidence intervals (CIs) compared to one‐stage models in the zero event situation. In the few trials scenario, the CI lengths were widest for the BBM on average and significance often changed compared to the PM and REML, despite the relatively wide CIs of the latter. In agreement with simulations and guidelines for meta‐analyses with zero event trials, our results suggest that one‐stage models are preferable. The best model can be either selected based on the data situation or, using a method that can be used in various situations. In the few trial situation, using BBM and additionally PM or REML for sensitivity analyses appears reasonable when conservative results are desired. Overall, our results encourage careful method selection.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany.
- Epidemiology Unit, German Rheumatism Research Centre Berlin, An institute of the Leibniz Association, Berlin, Germany.
- Institute for Biometrics and Epidemiology, German Diabetes Center (DDZ), Leibniz Center for Diabetes Research at Heinrich Heine University Düsseldorf, Düsseldorf, Germany.
ORCID-Profile: Maxi Schulz, Malte Kramer, Oliver Kuss
Zitieren
APA
Schulz, M., Kramer, M., Kuss, O., & Mathes, T. (2024). A re‐analysis of about 60,000 sparse data meta‐analyses suggests that using an adequate method for pooling matters. Research Synthesis Methods, 15(6), 978-987. https://doi.org/10.1002/jrsm.1748
Vancouver
Schulz M, Kramer M, Kuss O, Mathes T. A re‐analysis of about 60,000 sparse data meta‐analyses suggests that using an adequate method for pooling matters. Research Synthesis Methods. 2024;15(6):978-987. doi:10.1002/jrsm.1748
BibTeX
@article{Schulz2024,
author = {Schulz, Maxi and Kramer, Malte and Kuss, Oliver and Mathes, Tim},
title = {A re‐analysis of about 60,000 sparse data meta‐analyses suggests that using an adequate method for pooling matters},
journal = {Research Synthesis Methods},
year = {2024},
volume = {15},
number = {6},
pages = {978--987},
doi = {10.1002/jrsm.1748}
}
EUVIMED