Examining uncertainty in journal peer reviewers’ recommendations: a cross-sectional study
Royal Society Open Science · 2024-09 · 11 (9)
DOI: 10.1098/rsos.240612 ↗Kurz gefasst
Querschnittstudie in der Zeitschrift Royal Society Open Science, online erschienen am 11.09.2024. Verfasst von Adrian Barnett und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Public Health & Social Work, Queensland University of Technology, Brisbane, Australia. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The peer review process is used throughout science but has often been criticized for being inconsistent, with decisions dependent on the peers who did the reviewing. Much of the decision inconsistency arises from the differences between reviewers in terms of their expertise, training and experience. Another source of uncertainty is within reviewers as they must make a single recommendation (e.g. ‘Accept’), when they may have wavered between two (e.g. ‘Accept’ or ‘Reject’). We estimated the size of within-reviewer uncertainty using post-review surveys at three journals. We asked reviewers to think outside the recommendation they gave (e.g. ‘Accept’) and assign percentages to all other recommendations (e.g. ‘Major revision’). Reviewers who were certain could assign 100% to one recommendation. Twenty-three per cent of reviewers reported no uncertainty (95% confidence interval 19–27%). Women were associated with more uncertainty at one journal, and protocol papers were associated with more uncertainty at one journal. Reviewers commonly experience some uncertainty when peer-reviewing journal articles. This uncertainty is part of the variability in peer reviewers’ recommendation.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Public Health & Social Work, Queensland University of Technology, Brisbane, Australia.
- Taylor & Francis, London, UK.
- Policy Institute, King's College London, London, UK.
- BMJ Publishing Group, London, UK.
- Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, USA.
- School of Medicine and Public Health, University of Newcastle, Callaghan, Australia.
ORCID-Profile: Adrian Barnett, Victoria McCreanor
Zitieren
APA
Barnett, A., Allen, L., Aldcroft, A., Lash, T. L., & McCreanor, V. (2024). Examining uncertainty in journal peer reviewers’ recommendations: a cross-sectional study. Royal Society Open Science, 11(9). https://doi.org/10.1098/rsos.240612
Vancouver
Barnett A, Allen L, Aldcroft A, Lash TL, McCreanor V. Examining uncertainty in journal peer reviewers’ recommendations: a cross-sectional study. Royal Society Open Science. 2024;11(9). doi:10.1098/rsos.240612
BibTeX
@article{Barnett2024,
author = {Barnett, Adrian and Allen, Liz and Aldcroft, Adrian and Lash, Timothy L and McCreanor, Victoria},
title = {Examining uncertainty in journal peer reviewers’ recommendations: a cross-sectional study},
journal = {Royal Society Open Science},
year = {2024},
volume = {11},
number = {9},
doi = {10.1098/rsos.240612}
}
EUVIMED