Z-curve 2.0: Estimating Replication Rates and Discovery Rates
Meta-Psychology · 01.09.2022 · 6
DOI: 10.15626/mp.2021.2720 ↗Kurz gefasst
Fachartikel in der Zeitschrift Meta-Psychology, online erschienen am 01.09.2022. Verfasst von František Bartoš und 1 weiteren Autor:innen. Die Arbeit wurde bisher 54-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Selection for statistical significance is a well-known factor that distorts the published literature and challenges the cumulative progress in science. Recent replication failures have fueled concerns that many published results are false-positives. Brunner and Schimmack (2020) developed z-curve, a method for estimating the expected replication rate (ERR) – the predicted success rate of exact replication studies based on the mean power after selection for significance. This article introduces an extension of this method, z-curve 2.0. The main extension is an estimate of the expected discovery rate (EDR) – the estimate of a proportion that the reported statistically significant results constitute from all conducted statistical tests. This information can be used to detect and quantify the amount of selection bias by comparing the EDR to the observed discovery rate (ODR; observed proportion of statistically significant results). In addition, we examined the performance of bootstrapped confidence intervals in simulation studies. Based on these results, we created robust confidence intervals with good coverage across a wide range of scenarios to provide information about the uncertainty in EDR and ERR estimates. We implemented the method in the zcurve R package (Bartoš & Schimmack, 2020).
Zitieren
APA
Bartoš, F., & Schimmack, U. (2022). Z-curve 2.0: Estimating Replication Rates and Discovery Rates. Meta-Psychology, 6. https://doi.org/10.15626/mp.2021.2720
Vancouver
Bartoš F, Schimmack U. Z-curve 2.0: Estimating Replication Rates and Discovery Rates. Meta-Psychology. 2022;6. doi:10.15626/mp.2021.2720
BibTeX
@article{Barto2022,
author = {Bartoš, František and Schimmack, Ulrich},
title = {Z-curve 2.0: Estimating Replication Rates and Discovery Rates},
journal = {Meta-Psychology},
year = {2022},
volume = {6},
doi = {10.15626/mp.2021.2720}
}
EUVIMED