EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A supervised machine learning approach for assessing grant peer review reports

Gabriel Okasa, Alberto de León, Michaela Strinzel, Anne Jorstad, Katrin Milzow, Matthias Egger, Stefan Müller

Quantitative Science Studies · 08.11.2025 · 6 · 1189-1214

DOI: 10.1162/qss.a.23 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Quantitative Science Studies, online erschienen am 08.11.2025. Verfasst von Gabriel Okasa und 6 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Swiss National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Peer review is essential to the research lifecycle, yet the contents of grant peer review reports remain underexplored. Our study addresses this gap by developing a pipeline to systematically analyze these reports using natural language processing and machine learning. We define 12 categories relevant to funding agencies, create an annotation codebook, fine-tune and validate transformer models, and apply these classifiers to a novel text corpus consisting of 1.6 million sentences from 47,522 grant peer review reports submitted to the Swiss National Science Foundation. This work has critical implications for the academic community. It provides novel insights into the content of grant peer review reports and openly available tools to enhance transparency, fairness, and consistency in grant evaluation. Our findings also highlight differences between journal and grant peer reviews, while the developed framework enables funding agencies and researchers to refine practices, fostering a more trustworthy and efficient evaluation process.

Förderung

  • Swiss National Science Foundation

Zitieren

APA

Okasa, G., León, A. D., Strinzel, M., Jorstad, A., Milzow, K., Egger, M., & Müller, S. (2025). A supervised machine learning approach for assessing grant peer review reports. Quantitative Science Studies, 6, 1189-1214. https://doi.org/10.1162/qss.a.23

Vancouver

Okasa G, León AD, Strinzel M, Jorstad A, Milzow K, Egger M, et al. A supervised machine learning approach for assessing grant peer review reports. Quantitative Science Studies. 2025;6:1189-1214. doi:10.1162/qss.a.23

BibTeX
@article{Okasa2025,
  author = {Okasa, Gabriel and León, Alberto de and Strinzel, Michaela and Jorstad, Anne and Milzow, Katrin and Egger, Matthias and Müller, Stefan},
  title = {A supervised machine learning approach for assessing grant peer review reports},
  journal = {Quantitative Science Studies},
  year = {2025},
  volume = {6},
  pages = {1189--1214},
  doi = {10.1162/qss.a.23}
}
Kostenlos starten →