EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

What’s in a Badge? A Computational Reproducibility Investigation of the Open Data Badge Policy in One Issue of Psychological Science

Sophia Crüwell iD, Deborah Apthorp iD, Bradley J Baker iD, Lincoln Colling iD, Malte Elson iD, Sandra J Geiger iD, Sebastian Lobentanzer, Jean Monéger iD, Alex Patterson iD, D Samuel Schwarzkopf, Mirela Zaneva iD, Nicholas J L Brown iD

Psychological Science · 2023

DOI: 10.1177/09567976221140828 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Psychological Science, 2023. Verfasst von Sophia Crüwell und 11 weiteren Autor:innen. Beteiligte Einrichtung: Meta-Research Innovation Center Berlin (METRIC-B), QUEST Center for Transforming Biomedical Research, Berlin Institute of Health, Charité - Universit…. Hauptthemen laut MEDLINE: Psychology, Periodicals as Topic, Editorial Policies. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Economic and Social Research Council, Ministerium für Kultur und Wissenschaft des Landes Nordrhein-Westfalen.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In April 2019, Psychological Science published its first issue in which all Research Articles received the Open Data badge. We used that issue to investigate the effectiveness of this badge, focusing on the adherence to its aim at Psychological Science : sharing both data and code to ensure reproducibility of results. Twelve researchers of varying experience levels attempted to reproduce the results of the empirical articles in the target issue (at least three researchers per article). We found that all 14 articles provided at least some data and six provided analysis code, but only one article was rated to be exactly reproducible, and three were rated as essentially reproducible with minor deviations. We suggest that researchers should be encouraged to adhere to the higher standard in force at Psychological Science . Moreover, a check of reproducibility during peer review may be preferable to the disclosure method of awarding badges.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

PsychologyPeriodicals as TopicEditorial PoliciesHumansReproducibility of ResultsResearchInformation Dissemination

Stichwörter der Autor:innen

data sharingjournal policyopen badgesopen datareproducibility

Autor:innen und Institutionen

  • Meta-Research Innovation Center Berlin (METRIC-B), QUEST Center for Transforming Biomedical Research, Berlin Institute of Health, Charité - Universitätsmedizin Berlin.
  • Department of History and Philosophy of Science, University of Cambridge.
  • School of Psychology, University of New England.
  • School of Computing, Australian National University.
  • Department of Sport and Recreation Management, Temple University.
  • School of Psychology, University of Sussex.

ORCID-Profile: Sophia Crüwell, Deborah Apthorp, Bradley J Baker, Lincoln Colling, Malte Elson, Sandra J Geiger, Jean Monéger, Alex Patterson, Mirela Zaneva, Nicholas J L Brown

Förderung

  • Economic and Social Research Council
  • Ministerium für Kultur und Wissenschaft des Landes Nordrhein-Westfalen

Zitieren

APA

Crüwell, S., Apthorp, D., Baker, B. J., Colling, L., Elson, M., Geiger, S. J., Lobentanzer, S., Monéger, J., Patterson, A., Schwarzkopf, D. S., Zaneva, M., & Brown, N. J. L. (2023). What’s in a Badge? A Computational Reproducibility Investigation of the Open Data Badge Policy in One Issue of Psychological Science. Psychological Science. https://doi.org/10.1177/09567976221140828

Vancouver

Crüwell S, Apthorp D, Baker BJ, Colling L, Elson M, Geiger SJ, et al. What’s in a Badge? A Computational Reproducibility Investigation of the Open Data Badge Policy in One Issue of Psychological Science. Psychological Science. 2023. doi:10.1177/09567976221140828

BibTeX
@article{Crwell2023,
  author = {Crüwell, Sophia and Apthorp, Deborah and Baker, Bradley J and Colling, Lincoln and Elson, Malte and Geiger, Sandra J and Lobentanzer, Sebastian and Monéger, Jean and Patterson, Alex and Schwarzkopf, D Samuel and Zaneva, Mirela and Brown, Nicholas J L},
  title = {What’s in a Badge? A Computational Reproducibility Investigation of the Open Data Badge Policy in One Issue of Psychological Science},
  journal = {Psychological Science},
  year = {2023},
  doi = {10.1177/09567976221140828}
}
Kostenlos starten →