EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Robust point and variance estimation for meta‐analyses with selective reporting and dependent effect sizes

Yefeng Yang, Malgorzata Lagisz, Coralie Williams, Daniel W. A. Noble, Jinming Pan, Shinichi Nakagawa

Methods in Ecology and Evolution · 2024-09 · 15 (9) · 1593-1610

DOI: 10.1111/2041-210x.14377 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Methods in Ecology and Evolution, online erschienen am 09.07.2024. Verfasst von Yefeng Yang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Australian Research Council, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Meta‐analysis produces a quantitative synthesis of evidence‐based knowledge, shaping not only research trends but also policies and practices in biology. However, two statistical issues, selective reporting and statistical dependence, can severely distort meta‐analytic parameter estimation and inference. Here, we re‐analyse 448 meta‐analyses to demonstrate a new two‐step procedure to deal with two common challenges in biological meta‐analyses that often occur simultaneously: publication bias and non‐independence. First, we employ bias‐robust weighting schemes under the generalized least square estimator to obtain average effect sizes that are more robust to selective reporting. We then use cluster‐robust variance estimation to account for statistical dependence, reducing bias in estimating standard errors and ensuring valid statistical inference. The first step of our approach demonstrates comparable performance in estimating average effect sizes to the existing publication‐bias adjustment methods in the presence of selective reporting. This equivalence holds across two publication bias selection processes. The second step achieves estimates of standard errors consistent with the multilevel meta‐analytic model, a benchmark method with adequate control of Type I error rates for multiple, statistically dependent effect sizes. Re‐analyses of 448 meta‐analyses show that ignoring these two issues tends to overestimate effect sizes by an average of 110% and underestimate standard errors by 120%. To facilitate implementation, we have developed a website including a step‐by‐step tutorial. Complementing current meta‐analytic workflows with the proposed method as a sensitivity analysis can facilitate a transition to a more robust approach in quantitative evidence synthesis.

Förderung

  • Australian Research Council
  • National Natural Science Foundation of China

Zitieren

APA

Yang, Y., Lagisz, M., Williams, C., Noble, D. W. A., Pan, J., & Nakagawa, S. (2024). Robust point and variance estimation for meta‐analyses with selective reporting and dependent effect sizes. Methods in Ecology and Evolution, 15(9), 1593-1610. https://doi.org/10.1111/2041-210x.14377

Vancouver

Yang Y, Lagisz M, Williams C, Noble DWA, Pan J, Nakagawa S. Robust point and variance estimation for meta‐analyses with selective reporting and dependent effect sizes. Methods in Ecology and Evolution. 2024;15(9):1593-1610. doi:10.1111/2041-210x.14377

BibTeX
@article{Yang2024,
  author = {Yang, Yefeng and Lagisz, Malgorzata and Williams, Coralie and Noble, Daniel W. A. and Pan, Jinming and Nakagawa, Shinichi},
  title = {Robust point and variance estimation for meta‐analyses with selective reporting and dependent effect sizes},
  journal = {Methods in Ecology and Evolution},
  year = {2024},
  volume = {15},
  number = {9},
  pages = {1593--1610},
  doi = {10.1111/2041-210x.14377}
}
Kostenlos starten →