EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Relationship between journal impact factor and the thoroughness and helpfulness of peer reviews

Anna Severin, Michaela Strinzel, Matthias Egger iD, Tiago Barros, Alexander Sokolov, Julia Vilstrup Mouatt, Stefan Müller

PLOS Biology · 29.08.2023 · 21 (8) · e3002238

DOI: 10.1371/journal.pbio.3002238 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Biology, online erschienen am 29.08.2023. Verfasst von Anna Severin und 6 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland. Hauptthemen laut MEDLINE: Journal Impact Factor. Die Arbeit wurde bisher 45-mal zitiert (Crossref) und nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The Journal Impact Factor is often used as a proxy measure for journal quality, but the empirical evidence is scarce. In particular, it is unclear how peer review characteristics for a journal relate to its impact factor. We analysed 10,000 peer review reports submitted to 1,644 biomedical journals with impact factors ranging from 0.21 to 74.7. Two researchers hand-coded sentences using categories of content related to the thoroughness of the review ( Materials and Methods , Presentation and Reporting , Results and Discussion , Importance and Relevance ) and helpfulness ( Suggestion and Solution , Examples , Praise , Criticism ). We fine-tuned and validated transformer machine learning language models to classify sentences. We then examined the association between the number and percentage of sentences addressing different content categories and 10 groups defined by the Journal Impact Factor . The median length of reviews increased with higher impact factor, from 185 words (group 1) to 387 words (group 10). The percentage of sentences addressing Materials and Methods was greater in the highest Journal Impact Factor journals than in the lowest Journal Impact Factor group. The results for Presentation and Reporting went in the opposite direction, with the highest Journal Impact Factor journals giving less emphasis to such content. For helpfulness, reviews for higher impact factor journals devoted relatively less attention to Suggestion and Solution than lower impact factor journals. In conclusion, peer review in journals with higher impact factors tends to be more thorough, particularly in addressing study methods while giving relatively less emphasis to presentation or suggesting solutions. Differences were modest and variability high, indicating that the Journal Impact Factor is a bad predictor of the quality of peer review of an individual manuscript.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Journal Impact FactorLanguagePeer Review

Autor:innen und Institutionen

  • Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland.
  • Graduate School for Health Sciences, University of Bern, Bern, Switzerland.
  • Swiss National Science Foundation, Bern, Switzerland.
  • Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom.
  • Faculty Opinions, London, United Kingdom.
  • Clarivate, London, United Kingdom.

ORCID-Profile: Matthias Egger

Förderung

  • Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung

Zitieren

APA

Severin, A., Strinzel, M., Egger, M., Barros, T., Sokolov, A., Mouatt, J. V., & Müller, S. (2023). Relationship between journal impact factor and the thoroughness and helpfulness of peer reviews. PLOS Biology, 21(8), e3002238. https://doi.org/10.1371/journal.pbio.3002238

Vancouver

Severin A, Strinzel M, Egger M, Barros T, Sokolov A, Mouatt JV, et al. Relationship between journal impact factor and the thoroughness and helpfulness of peer reviews. PLOS Biology. 2023;21(8):e3002238. doi:10.1371/journal.pbio.3002238

BibTeX
@article{Severin2023,
  author = {Severin, Anna and Strinzel, Michaela and Egger, Matthias and Barros, Tiago and Sokolov, Alexander and Mouatt, Julia Vilstrup and Müller, Stefan},
  title = {Relationship between journal impact factor and the thoroughness and helpfulness of peer reviews},
  journal = {PLOS Biology},
  year = {2023},
  volume = {21},
  number = {8},
  pages = {e3002238},
  doi = {10.1371/journal.pbio.3002238}
}
Kostenlos starten →