A tutorial on aggregating evidence from conceptual replication studies using the product Bayes factor
Research Synthesis Methods · 2024
DOI: 10.1002/jrsm.1765 ↗Kurz gefasst
Fachartikel in der Zeitschrift Research Synthesis Methods, 2024. Verfasst von Caspar J Van Lissa und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Methodology & Statistics, Tilburg University, Tilburg, The Netherlands. Hauptthemen laut MEDLINE: Algorithms, Bayes Theorem, Computer Simulation, Meta-Analysis as Topic. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Nederlandse Organisatie voor Wetenschappelijk Onderzoek.
Abstract (Originalsprache)
The product Bayes factor (PBF) synthesizes evidence for an informative hypothesis across heterogeneous replication studies. It can be used when fixed‐ or random effects meta‐analysis fall short. For example, when effect sizes are incomparable and cannot be pooled, or when studies diverge significantly in the populations, study designs, and measures used. PBF shines as a solution for small sample meta‐analyses, where the number of between‐study differences is often large relative to the number of studies, precluding the use of meta‐regression to account for these differences. Users should be mindful of the fact that the PBF answers a qualitatively different research question than other evidence synthesis methods. For example, whereas fixed‐effect meta‐analysis estimates the size of a population effect, the PBF quantifies to what extent an informative hypothesis is supported in all included studies. This tutorial paper showcases the user‐friendly PBF functionality within the bain R‐package. This new implementation of an existing method was validated using a simulation study, available in an Online Supplement. Results showed that PBF had a high overall accuracy, due to greater sensitivity and lower specificity, compared to random‐effects meta‐analysis, individual participant data meta‐analysis, and vote counting. Tutorials demonstrate applications of the method on meta‐analytic and individual participant data. The example datasets, based on published research, are included in bain so readers can reproduce the examples and apply the code to their own data. The PBF is a promising method for synthesizing evidence for informative hypotheses across conceptual replications that are not suitable for conventional meta‐analysis.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Methodology & Statistics, Tilburg University, Tilburg, The Netherlands.
- Department of Methodology & Statistics, Utrecht University, Utrecht, The Netherlands.
ORCID-Profile: Caspar J Van Lissa, Rebecca Kuiper
Förderung
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
Zitieren
APA
Van Lissa, C. J., Clapper, E. B., & Kuiper, R. (2024). A tutorial on aggregating evidence from conceptual replication studies using the product Bayes factor. Research Synthesis Methods. https://doi.org/10.1002/jrsm.1765
Vancouver
Van Lissa CJ, Clapper EB, Kuiper R. A tutorial on aggregating evidence from conceptual replication studies using the product Bayes factor. Research Synthesis Methods. 2024. doi:10.1002/jrsm.1765
BibTeX
@article{VanLissa2024,
author = {Van Lissa, Caspar J and Clapper, Eli-Boaz and Kuiper, Rebecca},
title = {A tutorial on aggregating evidence from conceptual replication studies using the product Bayes factor},
journal = {Research Synthesis Methods},
year = {2024},
doi = {10.1002/jrsm.1765}
}
EUVIMED