EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Footprint of publication selection bias on meta‐analyses in medicine, environmental sciences, psychology, and economics

František Bartoš iD, Maximilian Maier iD, Eric-Jan Wagenmakers iD, Franziska Nippold, Hristos Doucouliagos iD, John P A Ioannidis iD, Willem M Otte iD, Martina Sladekova iD, Teshome K Deresssa iD, Stephan B Bruns iD, Daniele Fanelli iD, T D Stanley iD

Research Synthesis Methods · 2024-05 · 15 (3) · 500-511

DOI: 10.1002/jrsm.1703 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Research Synthesis Methods, online erschienen am 07.02.2024. Verfasst von František Bartoš und 11 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychological Methods, University of Amsterdam, Amsterdam, Netherlands. Hauptthemen laut MEDLINE: Publication Bias, Meta-Analysis as Topic, Psychology, Economics. Die Arbeit wurde bisher 56-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Nederlandse Organisatie voor Wetenschappelijk Onderzoek, Special Research Fund (BOF) of Hasselt University, German Research Foundation (DFG).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Publication selection bias undermines the systematic accumulation of evidence. To assess the extent of this problem, we survey over 68,000 meta‐analyses containing over 700,000 effect size estimates from medicine (67,386/597,699), environmental sciences (199/12,707), psychology (605/23,563), and economics (327/91,421). Our results indicate that meta‐analyses in economics are the most severely contaminated by publication selection bias, closely followed by meta‐analyses in environmental sciences and psychology, whereas meta‐analyses in medicine are contaminated the least. After adjusting for publication selection bias, the median probability of the presence of an effect decreased from 99.9% to 29.7% in economics, from 98.9% to 55.7% in psychology, from 99.8% to 70.7% in environmental sciences, and from 38.0% to 29.7% in medicine. The median absolute effect sizes (in terms of standardized mean differences) decreased from d = 0.20 to d = 0.07 in economics, from d = 0.37 to d = 0.26 in psychology, from d = 0.62 to d = 0.43 in environmental sciences, and from d = 0.24 to d = 0.13 in medicine.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Publication BiasMeta-Analysis as TopicPsychologyEconomicsHumansEcologyResearch DesignSelection BiasProbabilityMedicine

Stichwörter der Autor:innen

BayesianRoBMAeffect sizesevidencemeta‐analysismodel‐averagingpublication bias

Autor:innen und Institutionen

  • Department of Psychological Methods, University of Amsterdam, Amsterdam, Netherlands.
  • Institute of Computer Science, Czech Academy of Sciences, Prague, Czech Republic.
  • Department of Experimental Psychology, University College London, London, UK.
  • Department of Psychology, University of Amsterdam, Amsterdam, Netherlands.
  • Department of Economics, Deakin University, Geelong, Victoria, Australia.
  • Meta-Research Innovation Center at Stanford (METRICS), Stanford, California, USA.

ORCID-Profile: František Bartoš, Maximilian Maier, Eric-Jan Wagenmakers, Hristos Doucouliagos, John P A Ioannidis, Willem M Otte, Martina Sladekova, Teshome K Deresssa, Stephan B Bruns, Daniele Fanelli, T D Stanley

Förderung

  • Nederlandse Organisatie voor Wetenschappelijk Onderzoek
  • Special Research Fund (BOF) of Hasselt University
  • German Research Foundation (DFG)
  • Bijzonder Onderzoeksfonds UGent

Zitieren

APA

Bartoš, F., Maier, M., Wagenmakers, E. J., Nippold, F., Doucouliagos, H., Ioannidis, J. P. A., Otte, W. M., Sladekova, M., Deresssa, T. K., Bruns, S. B., Fanelli, D., & Stanley, T. D. (2024). Footprint of publication selection bias on meta‐analyses in medicine, environmental sciences, psychology, and economics. Research Synthesis Methods, 15(3), 500-511. https://doi.org/10.1002/jrsm.1703

Vancouver

Bartoš F, Maier M, Wagenmakers EJ, Nippold F, Doucouliagos H, Ioannidis JPA, et al. Footprint of publication selection bias on meta‐analyses in medicine, environmental sciences, psychology, and economics. Research Synthesis Methods. 2024;15(3):500-511. doi:10.1002/jrsm.1703

BibTeX
@article{Barto2024,
  author = {Bartoš, František and Maier, Maximilian and Wagenmakers, Eric-Jan and Nippold, Franziska and Doucouliagos, Hristos and Ioannidis, John P A and Otte, Willem M and Sladekova, Martina and Deresssa, Teshome K and Bruns, Stephan B and Fanelli, Daniele and Stanley, T D},
  title = {Footprint of publication selection bias on meta‐analyses in medicine, environmental sciences, psychology, and economics},
  journal = {Research Synthesis Methods},
  year = {2024},
  volume = {15},
  number = {3},
  pages = {500--511},
  doi = {10.1002/jrsm.1703}
}
Kostenlos starten →