A supervised machine learning approach for assessing grant peer review reports
Quantitative Science Studies · 08.11.2025 · 6 · 1189-1214
DOI: 10.1162/qss.a.23 ↗Kurz gefasst
Fachartikel in der Zeitschrift Quantitative Science Studies, online erschienen am 08.11.2025. Verfasst von Gabriel Okasa und 6 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Swiss National Science Foundation.
Abstract (Originalsprache)
Peer review is essential to the research lifecycle, yet the contents of grant peer review reports remain underexplored. Our study addresses this gap by developing a pipeline to systematically analyze these reports using natural language processing and machine learning. We define 12 categories relevant to funding agencies, create an annotation codebook, fine-tune and validate transformer models, and apply these classifiers to a novel text corpus consisting of 1.6 million sentences from 47,522 grant peer review reports submitted to the Swiss National Science Foundation. This work has critical implications for the academic community. It provides novel insights into the content of grant peer review reports and openly available tools to enhance transparency, fairness, and consistency in grant evaluation. Our findings also highlight differences between journal and grant peer reviews, while the developed framework enables funding agencies and researchers to refine practices, fostering a more trustworthy and efficient evaluation process.
Förderung
- Swiss National Science Foundation
Zitieren
APA
Okasa, G., León, A. D., Strinzel, M., Jorstad, A., Milzow, K., Egger, M., & Müller, S. (2025). A supervised machine learning approach for assessing grant peer review reports. Quantitative Science Studies, 6, 1189-1214. https://doi.org/10.1162/qss.a.23
Vancouver
Okasa G, León AD, Strinzel M, Jorstad A, Milzow K, Egger M, et al. A supervised machine learning approach for assessing grant peer review reports. Quantitative Science Studies. 2025;6:1189-1214. doi:10.1162/qss.a.23
BibTeX
@article{Okasa2025,
author = {Okasa, Gabriel and León, Alberto de and Strinzel, Michaela and Jorstad, Anne and Milzow, Katrin and Egger, Matthias and Müller, Stefan},
title = {A supervised machine learning approach for assessing grant peer review reports},
journal = {Quantitative Science Studies},
year = {2025},
volume = {6},
pages = {1189--1214},
doi = {10.1162/qss.a.23}
}
EUVIMED