EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

A discipline-wide investigation of the replicability of Psychology papers over the past two decades

Wu Youyou iD, Yang Yang, Brian Uzzi

Proceedings of the National Academy of Sciences · 07.02.2023 · 120 (6)

DOI: 10.1073/pnas.2208863120 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the National Academy of Sciences, online erschienen am 30.01.2023. Verfasst von Wu Youyou und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology and Human Development, Institute of Education, University College London, London WC1H 0AL. Hauptthemen laut MEDLINE: Social Sciences, Attention. Die Arbeit wurde bisher 73-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Conjecture about the weak replicability in social sciences has made scholars eager to quantify the scale and scope of replication failure for a discipline. Yet small-scale manual replication methods alone are ill-suited to deal with this big data problem. Here, we conduct a discipline-wide replication census in science. Our sample ( N = 14,126 papers) covers nearly all papers published in the six top-tier Psychology journals over the past 20 y. Using a validated machine learning model that estimates a paper’s likelihood of replication, we found evidence that both supports and refutes speculations drawn from a relatively small sample of manual replications. First, we find that a single overall replication rate of Psychology poorly captures the varying degree of replicability among subfields. Second, we find that replication rates are strongly correlated with research methods in all subfields. Experiments replicate at a significantly lower rate than do non-experimental studies. Third, we find that authors’ cumulative publication number and citation impact are positively related to the likelihood of replication, while other proxies of research quality and rigor, such as an author’s university prestige and a paper’s citations, are unrelated to replicability. Finally, contrary to the ideal that media attention should cover replicable research, we find that media attention is positively related to the likelihood of replication failure. Our assessments of the scale and scope of replicability are important next steps toward broadly resolving issues of replicability.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Social SciencesAttentionHumansProbabilityResearch DesignMachine LearningPsychology

Stichwörter der Autor:innen

machine learningpsychologyreplicationscience of science

Autor:innen und Institutionen

  • Department of Psychology and Human Development, Institute of Education, University College London, London WC1H 0AL.
  • Mendoza College of Business, University of Notre Dame, Notre Dame, IN 46556.
  • Kellogg School of Management, Northwestern University, Evanston, IL 60201.
  • Northwestern Institute of Complex Systems, Northwestern University, Evanston, IL 60201.

ORCID-Profile: Wu Youyou

Förderung

  • National Science Foundation

Zitieren

APA

Youyou, W., Yang, Y., & Uzzi, B. (2023). A discipline-wide investigation of the replicability of Psychology papers over the past two decades. Proceedings of the National Academy of Sciences, 120(6). https://doi.org/10.1073/pnas.2208863120

Vancouver

Youyou W, Yang Y, Uzzi B. A discipline-wide investigation of the replicability of Psychology papers over the past two decades. Proceedings of the National Academy of Sciences. 2023;120(6). doi:10.1073/pnas.2208863120

BibTeX
@article{Youyou2023,
  author = {Youyou, Wu and Yang, Yang and Uzzi, Brian},
  title = {A discipline-wide investigation of the replicability of Psychology papers over the past two decades},
  journal = {Proceedings of the National Academy of Sciences},
  year = {2023},
  volume = {120},
  number = {6},
  doi = {10.1073/pnas.2208863120}
}
Kostenlos starten →