Footprint of publication selection bias on meta‐analyses in medicine, environmental sciences, psychology, and economics
Research Synthesis Methods · 2024-05 · 15 (3) · 500-511
DOI: 10.1002/jrsm.1703 ↗Kurz gefasst
Fachartikel in der Zeitschrift Research Synthesis Methods, online erschienen am 07.02.2024. Verfasst von František Bartoš und 11 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychological Methods, University of Amsterdam, Amsterdam, Netherlands. Hauptthemen laut MEDLINE: Publication Bias, Meta-Analysis as Topic, Psychology, Economics. Die Arbeit wurde bisher 56-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Nederlandse Organisatie voor Wetenschappelijk Onderzoek, Special Research Fund (BOF) of Hasselt University, German Research Foundation (DFG).
Abstract (Originalsprache)
Publication selection bias undermines the systematic accumulation of evidence. To assess the extent of this problem, we survey over 68,000 meta‐analyses containing over 700,000 effect size estimates from medicine (67,386/597,699), environmental sciences (199/12,707), psychology (605/23,563), and economics (327/91,421). Our results indicate that meta‐analyses in economics are the most severely contaminated by publication selection bias, closely followed by meta‐analyses in environmental sciences and psychology, whereas meta‐analyses in medicine are contaminated the least. After adjusting for publication selection bias, the median probability of the presence of an effect decreased from 99.9% to 29.7% in economics, from 98.9% to 55.7% in psychology, from 99.8% to 70.7% in environmental sciences, and from 38.0% to 29.7% in medicine. The median absolute effect sizes (in terms of standardized mean differences) decreased from d = 0.20 to d = 0.07 in economics, from d = 0.37 to d = 0.26 in psychology, from d = 0.62 to d = 0.43 in environmental sciences, and from d = 0.24 to d = 0.13 in medicine.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychological Methods, University of Amsterdam, Amsterdam, Netherlands.
- Institute of Computer Science, Czech Academy of Sciences, Prague, Czech Republic.
- Department of Experimental Psychology, University College London, London, UK.
- Department of Psychology, University of Amsterdam, Amsterdam, Netherlands.
- Department of Economics, Deakin University, Geelong, Victoria, Australia.
- Meta-Research Innovation Center at Stanford (METRICS), Stanford, California, USA.
ORCID-Profile: František Bartoš, Maximilian Maier, Eric-Jan Wagenmakers, Hristos Doucouliagos, John P A Ioannidis, Willem M Otte, Martina Sladekova, Teshome K Deresssa, Stephan B Bruns, Daniele Fanelli, T D Stanley
Förderung
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
- Special Research Fund (BOF) of Hasselt University
- German Research Foundation (DFG)
- Bijzonder Onderzoeksfonds UGent
Zitieren
APA
Bartoš, F., Maier, M., Wagenmakers, E. J., Nippold, F., Doucouliagos, H., Ioannidis, J. P. A., Otte, W. M., Sladekova, M., Deresssa, T. K., Bruns, S. B., Fanelli, D., & Stanley, T. D. (2024). Footprint of publication selection bias on meta‐analyses in medicine, environmental sciences, psychology, and economics. Research Synthesis Methods, 15(3), 500-511. https://doi.org/10.1002/jrsm.1703
Vancouver
Bartoš F, Maier M, Wagenmakers EJ, Nippold F, Doucouliagos H, Ioannidis JPA, et al. Footprint of publication selection bias on meta‐analyses in medicine, environmental sciences, psychology, and economics. Research Synthesis Methods. 2024;15(3):500-511. doi:10.1002/jrsm.1703
BibTeX
@article{Barto2024,
author = {Bartoš, František and Maier, Maximilian and Wagenmakers, Eric-Jan and Nippold, Franziska and Doucouliagos, Hristos and Ioannidis, John P A and Otte, Willem M and Sladekova, Martina and Deresssa, Teshome K and Bruns, Stephan B and Fanelli, Daniele and Stanley, T D},
title = {Footprint of publication selection bias on meta‐analyses in medicine, environmental sciences, psychology, and economics},
journal = {Research Synthesis Methods},
year = {2024},
volume = {15},
number = {3},
pages = {500--511},
doi = {10.1002/jrsm.1703}
}
EUVIMED