EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Replication of null results: Absence of evidence or evidence of absence?

Samuel Pawel iD, Rachel Heyard iD, Charlotte Micheloud iD, Leonhard Held iD

eLife · 13.05.2024 · 12

DOI: 10.7554/elife.92311 ↗

Kurz gefasst

Fachartikel in der Zeitschrift eLife, online erschienen am 13.05.2024. Verfasst von Samuel Pawel und 3 weiteren Autor:innen. Beteiligte Einrichtung: Epidemiology, Biostatistics and Prevention Institute, Center for Reproducible Science, University of Zurich, Zurich, Switzerland. Hauptthemen laut MEDLINE: Bayes Theorem. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In several large-scale replication projects, statistically non-significant results in both the original and the replication study have been interpreted as a ‘replication success.’ Here, we discuss the logical problems with this approach: Non-significance in both studies does not ensure that the studies provide evidence for the absence of an effect and ‘replication success’ can virtually always be achieved if the sample sizes are small enough. In addition, the relevant error rates are not controlled. We show how methods, such as equivalence testing and Bayes factors, can be used to adequately quantify the evidence for the absence of an effect and how they can be applied in the replication setting. Using data from the Reproducibility Project: Cancer Biology, the Experimental Philosophy Replicability Project, and the Reproducibility Project: Psychology we illustrate that many original and replication studies with ‘null results’ are in fact inconclusive. We conclude that it is important to also replicate studies with statistically non-significant results, but that they should be designed, analyzed, and interpreted appropriately.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Bayes TheoremReproducibility of ResultsHumansResearch DesignSample SizeData Interpretation, Statistical

Stichwörter der Autor:innen

Bayesian hypothesis testingcancer biologyequivalence testingmeta-researchnonenull hypothesisreplication success

Autor:innen und Institutionen

  • Epidemiology, Biostatistics and Prevention Institute, Center for Reproducible Science, University of Zurich, Zurich, Switzerland.

ORCID-Profile: Samuel Pawel, Rachel Heyard, Charlotte Micheloud, Leonhard Held

Förderung

  • Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung

Zitieren

APA

Pawel, S., Heyard, R., Micheloud, C., & Held, L. (2024). Replication of null results: Absence of evidence or evidence of absence?. eLife, 12. https://doi.org/10.7554/elife.92311

Vancouver

Pawel S, Heyard R, Micheloud C, Held L. Replication of null results: Absence of evidence or evidence of absence?. eLife. 2024;12. doi:10.7554/elife.92311

BibTeX
@article{Pawel2024,
  author = {Pawel, Samuel and Heyard, Rachel and Micheloud, Charlotte and Held, Leonhard},
  title = {Replication of null results: Absence of evidence or evidence of absence?},
  journal = {eLife},
  year = {2024},
  volume = {12},
  doi = {10.7554/elife.92311}
}
Kostenlos starten →