The role of author identities in peer review
PLOS ONE · 2023
DOI: 10.1371/journal.pone.0286206 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, 2023. Verfasst von Nihar B Shah. Beteiligte Einrichtung: Machine Learning Department and Computer Science Department, Carnegie Mellon University, Pittsburgh, Pennsylvania, United States of America. Hauptthemen laut MEDLINE: Peer Review, Attitude. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
There is widespread debate on whether to anonymize author identities in peer review. The key argument for anonymization is to mitigate bias, whereas arguments against anonymization posit various uses of author identities in the review process. The Innovations in Theoretical Computer Science (ITCS) 2023 conference adopted a middle ground by initially anonymizing the author identities from reviewers, revealing them after the reviewer had submitted their initial reviews, and allowing the reviewer to change their review subsequently. We present an analysis of the reviews pertaining to the identification and use of author identities. Our key findings are: (I) A majority of reviewers self-report not knowing and being unable to guess the authors’ identities for the papers they were reviewing. (II) After the initial submission of reviews, 7.1% of reviews changed their overall merit score and 3.8% changed their self-reported reviewer expertise. (III) There is a very weak and statistically insignificant correlation of the rank of authors’ affiliations with the change in overall merit; there is a weak but statistically significant correlation with respect to change in reviewer expertise. We also conducted an anonymous survey to obtain opinions from reviewers and authors. The main findings from the 200 survey responses are: (i) A vast majority of participants favor anonymizing author identities in some form. (ii) The “middle-ground” initiative of ITCS 2023 was appreciated. (iii) Detecting conflicts of interest is a challenge that needs to be addressed if author identities are anonymized. Overall, these findings support anonymization of author identities in some form (e.g., as was done in ITCS 2023), as long as there is a robust and efficient way to check conflicts of interest.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Machine Learning Department and Computer Science Department, Carnegie Mellon University, Pittsburgh, Pennsylvania, United States of America.
ORCID-Profile: Nihar B Shah
Zitieren
APA
Shah, N. B. (2023). The role of author identities in peer review. PLOS ONE. https://doi.org/10.1371/journal.pone.0286206
Vancouver
Shah NB. The role of author identities in peer review. PLOS ONE. 2023. doi:10.1371/journal.pone.0286206
BibTeX
@article{Shah2023,
author = {Shah, Nihar B},
title = {The role of author identities in peer review},
journal = {PLOS ONE},
year = {2023},
doi = {10.1371/journal.pone.0286206}
}
EUVIMED