EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A tutorial on aggregating evidence from conceptual replication studies using the product Bayes factor

Caspar J Van Lissa iD, Eli-Boaz Clapper, Rebecca Kuiper iD

Research Synthesis Methods · 2024

DOI: 10.1002/jrsm.1765 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Research Synthesis Methods, 2024. Verfasst von Caspar J Van Lissa und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Methodology & Statistics, Tilburg University, Tilburg, The Netherlands. Hauptthemen laut MEDLINE: Algorithms, Bayes Theorem, Computer Simulation, Meta-Analysis as Topic. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Nederlandse Organisatie voor Wetenschappelijk Onderzoek.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The product Bayes factor (PBF) synthesizes evidence for an informative hypothesis across heterogeneous replication studies. It can be used when fixed‐ or random effects meta‐analysis fall short. For example, when effect sizes are incomparable and cannot be pooled, or when studies diverge significantly in the populations, study designs, and measures used. PBF shines as a solution for small sample meta‐analyses, where the number of between‐study differences is often large relative to the number of studies, precluding the use of meta‐regression to account for these differences. Users should be mindful of the fact that the PBF answers a qualitatively different research question than other evidence synthesis methods. For example, whereas fixed‐effect meta‐analysis estimates the size of a population effect, the PBF quantifies to what extent an informative hypothesis is supported in all included studies. This tutorial paper showcases the user‐friendly PBF functionality within the bain R‐package. This new implementation of an existing method was validated using a simulation study, available in an Online Supplement. Results showed that PBF had a high overall accuracy, due to greater sensitivity and lower specificity, compared to random‐effects meta‐analysis, individual participant data meta‐analysis, and vote counting. Tutorials demonstrate applications of the method on meta‐analytic and individual participant data. The example datasets, based on published research, are included in bain so readers can reproduce the examples and apply the code to their own data. The PBF is a promising method for synthesizing evidence for informative hypotheses across conceptual replications that are not suitable for conventional meta‐analysis.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AlgorithmsBayes TheoremComputer SimulationMeta-Analysis as TopicResearch DesignData Interpretation, StatisticalModels, StatisticalReproducibility of ResultsSensitivity and SpecificitySoftware

Stichwörter der Autor:innen

Bayes factorBayesianevidence synthesismeta‐analysis

Autor:innen und Institutionen

  • Department of Methodology & Statistics, Tilburg University, Tilburg, The Netherlands.
  • Department of Methodology & Statistics, Utrecht University, Utrecht, The Netherlands.

ORCID-Profile: Caspar J Van Lissa, Rebecca Kuiper

Förderung

  • Nederlandse Organisatie voor Wetenschappelijk Onderzoek

Zitieren

APA

Van Lissa, C. J., Clapper, E. B., & Kuiper, R. (2024). A tutorial on aggregating evidence from conceptual replication studies using the product Bayes factor. Research Synthesis Methods. https://doi.org/10.1002/jrsm.1765

Vancouver

Van Lissa CJ, Clapper EB, Kuiper R. A tutorial on aggregating evidence from conceptual replication studies using the product Bayes factor. Research Synthesis Methods. 2024. doi:10.1002/jrsm.1765

BibTeX
@article{VanLissa2024,
  author = {Van Lissa, Caspar J and Clapper, Eli-Boaz and Kuiper, Rebecca},
  title = {A tutorial on aggregating evidence from conceptual replication studies using the product Bayes factor},
  journal = {Research Synthesis Methods},
  year = {2024},
  doi = {10.1002/jrsm.1765}
}
Kostenlos starten →