EUVIMEDEUVIMED entdecken
Open Access

Prevalence of Short Peer Reviews in 3 Leading General Medical Journals

Pascal Geldsetzer, Markus Heemann, Pauli Tikka, Grace Wang, Marika Mae Cusick, Ali Lenjani, Nandita Krishnan

JAMA Network Open · 2023

DOI: 10.1001/jamanetworkopen.2023.47607 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JAMA Network Open, 2023. Verfasst von Pascal Geldsetzer und 6 weiteren Autor:innen. Beteiligte Einrichtung: Division of Primary Care and Population Health, Department of Medicine, Stanford University, Stanford, California. Hauptthemen laut MEDLINE: Peer Review, Periodicals as Topic. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Importance High-quality peer reviews are often thought to be essential to ensuring the integrity of the scientific publication process, but measuring peer review quality is challenging. Although imperfect, review word count could potentially serve as a simple, objective metric of review quality.

Objective

To determine the prevalence of very short peer reviews and how often they inform editorial decisions on research articles in 3 leading general medical journals. Design, Setting, and Participants This cross-sectional study compiled a data set of peer reviews from published, full-length original research articles from 3 general medical journals ( The BMJ , PLOS Medicine , and BMC Medicine ) between 2003 and 2022. Eligible articles were those with peer review data; all peer reviews used to make the first editorial decision (ie, accept vs revise and resubmit) were included. Main Outcomes and Measures Prevalence of very short reviews was the primary outcome, which was defined as a review of fewer than 200 words. In secondary analyses, thresholds of fewer than 100 words and fewer than 300 words were used. Results were disaggregated by journal and year. The proportion of articles for which the first editorial decision was made based on a set of peer reviews in which very short reviews constituted 100%, 50% or more, 33% or more, and 20% or more of the reviews was calculated.

Results

In this sample of 11 466 reviews (including 6086 in BMC Medicine , 3816 in The BMJ , and 1564 in PLOS Medicine ) corresponding to 4038 published articles, the median (IQR) word count per review was 425 (253-575) words, and the mean (SD) word count was 520.0 (401.0) words. The overall prevalence of very short (<200 words) peer reviews was 1958 of 11 466 reviews (17.1%). Across the 3 journals, 843 of 4038 initial editorial decisions (20.9%) were based on review sets containing 50% or more very short reviews. The prevalence of very short reviews and share of editorial decisions based on review sets containing 50% or more very short reviews was highest for BMC Medicine (693 of 2585 editorial decisions [26.8%]) and lowest for The BMJ (76 of 1040 editorial decisions [7.3%]). Conclusion and Relevance In this study of 3 leading general medical journals, one-fifth of initial editorial decisions for published articles were likely based at least partially on reviews of such short length that they were unlikely to be of high quality. Future research could determine whether monitoring peer review length improves the quality of peer reviews and which interventions, such as incentives and norm-based interventions, may elicit more detailed reviews.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Peer ReviewPeriodicals as TopicHumansCross-Sectional StudiesPrevalencePublications

Autor:innen und Institutionen

  • Division of Primary Care and Population Health, Department of Medicine, Stanford University, Stanford, California.
  • Chan Zuckerberg Biohub-San Francisco, San Francisco, California.
  • Department of Development Economics, Centre for Modern Indian Studies, University of Goettingen, Göttingen, Germany.
  • Institute of Biotechnology, University of Helsinki, Helsinki, Finland.
  • Department of Biology, Stanford University, Stanford, California.
  • Department of Health Policy, Stanford University, Stanford, California.

Zitieren

APA

Geldsetzer, P., Heemann, M., Tikka, P., Wang, G., Cusick, M. M., Lenjani, A., & Krishnan, N. (2023). Prevalence of Short Peer Reviews in 3 Leading General Medical Journals. JAMA Network Open. https://doi.org/10.1001/jamanetworkopen.2023.47607

Vancouver

Geldsetzer P, Heemann M, Tikka P, Wang G, Cusick MM, Lenjani A, et al. Prevalence of Short Peer Reviews in 3 Leading General Medical Journals. JAMA Network Open. 2023. doi:10.1001/jamanetworkopen.2023.47607

BibTeX
@article{Geldsetzer2023,
  author = {Geldsetzer, Pascal and Heemann, Markus and Tikka, Pauli and Wang, Grace and Cusick, Marika Mae and Lenjani, Ali and Krishnan, Nandita},
  title = {Prevalence of Short Peer Reviews in 3 Leading General Medical Journals},
  journal = {JAMA Network Open},
  year = {2023},
  doi = {10.1001/jamanetworkopen.2023.47607}
}
Kostenlos starten →