Sensitivity Analysis for Publication Bias in Meta-Analyses
Journal of the Royal Statistical Society Series C: Applied Statistics · 2020-11-01 · 69 (5) · 1091-1119
DOI: 10.1111/rssc.12440 ↗At a glance
Metaanalyse in Journal of the Royal Statistical Society Series C: Applied Statistics, published online on 2020-08-28. Written by Maya B Mathur and 1 co-authors. Institution: Stanford University Palo Alto USA. Cited 294 times so far (Crossref); 52 references. The full text is freely available (open access, CC BY-NC 4.0). Funded by: NCI NIH HHS, National Institutes of Health, John E. Fetzer Memorial Trust.
Abstract (original language)
We propose sensitivity analyses for publication bias in meta-analyses. We consider a publication process such that ‘statistically significant’ results are more likely to be published than negative or “non-significant” results by an unknown ratio, η. Our proposed methods also accommodate some plausible forms of selection based on a study's standard error. Using inverse probability weighting and robust estimation that accommodates non-normal population effects, small meta-analyses, and clustering, we develop sensitivity analyses that enable statements such as ‘For publication bias to shift the observed point estimate to the null, “significant” results would need to be at least 30 fold more likely to be published than negative or “non-significant” results’. Comparable statements can be made regarding shifting to a chosen non-null value or shifting the confidence interval. To aid interpretation, we describe empirical benchmarks for plausible values of η across disciplines. We show that a worst-case meta-analytic point estimate for maximal publication bias under the selection model can be obtained simply by conducting a standard meta-analysis of only the negative and ‘non-significant’ studies; this method sometimes indicates that no amount of such publication bias could ‘explain away’ the results. We illustrate the proposed methods by using real meta-analyses and provide an R package: PublicationBias.
Subjects
Author keywords
Authors and institutions
- Stanford University Palo Alto USA.
- Harvard T.H. Chan School of Public Health Boston USA.
Funding
- NCI NIH HHS
- National Institutes of Health
- John E. Fetzer Memorial Trust
Cite
APA
Mathur, M. B., & VanderWeele, T. J. (2020). Sensitivity Analysis for Publication Bias in Meta-Analyses. Journal of the Royal Statistical Society Series C: Applied Statistics, 69(5), 1091-1119. https://doi.org/10.1111/rssc.12440
Vancouver
Mathur MB, VanderWeele TJ. Sensitivity Analysis for Publication Bias in Meta-Analyses. Journal of the Royal Statistical Society Series C: Applied Statistics. 2020;69(5):1091-1119. doi:10.1111/rssc.12440
BibTeX
@article{Mathur2020,
author = {Mathur, Maya B and VanderWeele, Tyler J},
title = {Sensitivity Analysis for Publication Bias in Meta-Analyses},
journal = {Journal of the Royal Statistical Society Series C: Applied Statistics},
year = {2020},
volume = {69},
number = {5},
pages = {1091--1119},
doi = {10.1111/rssc.12440}
}
EUVIMED