Replication of null results: Absence of evidence or evidence of absence?
eLife · 13.05.2024 · 12
DOI: 10.7554/elife.92311 ↗Kurz gefasst
Fachartikel in der Zeitschrift eLife, online erschienen am 13.05.2024. Verfasst von Samuel Pawel und 3 weiteren Autor:innen. Beteiligte Einrichtung: Epidemiology, Biostatistics and Prevention Institute, Center for Reproducible Science, University of Zurich, Zurich, Switzerland. Hauptthemen laut MEDLINE: Bayes Theorem. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung.
Abstract (Originalsprache)
In several large-scale replication projects, statistically non-significant results in both the original and the replication study have been interpreted as a ‘replication success.’ Here, we discuss the logical problems with this approach: Non-significance in both studies does not ensure that the studies provide evidence for the absence of an effect and ‘replication success’ can virtually always be achieved if the sample sizes are small enough. In addition, the relevant error rates are not controlled. We show how methods, such as equivalence testing and Bayes factors, can be used to adequately quantify the evidence for the absence of an effect and how they can be applied in the replication setting. Using data from the Reproducibility Project: Cancer Biology, the Experimental Philosophy Replicability Project, and the Reproducibility Project: Psychology we illustrate that many original and replication studies with ‘null results’ are in fact inconclusive. We conclude that it is important to also replicate studies with statistically non-significant results, but that they should be designed, analyzed, and interpreted appropriately.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Epidemiology, Biostatistics and Prevention Institute, Center for Reproducible Science, University of Zurich, Zurich, Switzerland.
ORCID-Profile: Samuel Pawel, Rachel Heyard, Charlotte Micheloud, Leonhard Held
Förderung
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
Zitieren
APA
Pawel, S., Heyard, R., Micheloud, C., & Held, L. (2024). Replication of null results: Absence of evidence or evidence of absence?. eLife, 12. https://doi.org/10.7554/elife.92311
Vancouver
Pawel S, Heyard R, Micheloud C, Held L. Replication of null results: Absence of evidence or evidence of absence?. eLife. 2024;12. doi:10.7554/elife.92311
BibTeX
@article{Pawel2024,
author = {Pawel, Samuel and Heyard, Rachel and Micheloud, Charlotte and Held, Leonhard},
title = {Replication of null results: Absence of evidence or evidence of absence?},
journal = {eLife},
year = {2024},
volume = {12},
doi = {10.7554/elife.92311}
}
EUVIMED