Estimating the 5-Year Publication Potential for Grant Awardees: Analysis of the Peer Reviewed Orthopaedic Research Program
Military Medicine · 2025
DOI: 10.1093/milmed/usaf173 ↗Kurz gefasst
Fachartikel in der Zeitschrift Military Medicine, 2025. Verfasst von Ashley B Anderson und 6 weiteren Autor:innen. Beteiligte Einrichtung: Division of Orthopaedics, Department of Surgery, Walter Reed National Military Medical Center, Uniformed Services University, Bethesda, MA 20889, Uni…. Hauptthemen laut MEDLINE: Orthopedics, Peer Review, Research, Publications. Die Arbeit nennt 23 Literaturangaben.
Abstract (Originalsprache)
Introduction
Research-funding agencies are sometimes criticized for their ineffective review of grant proposals and for prioritizing competition for grants over project outcomes. Deficiencies in the review process for grants may limit the diversity of a program’s applicant pool and restrict opportunities for publication. Our study asked what features of Peer Reviewed Orthopaedic Research Program (PRORP) grants and grant recipients were associated with successful grant outcomes, with success defined as publication of results within 5 years of receipt of funding. Materials and Methods Using data from all PRORP grants from 2009 to 2017, we built machine-learned predictive models to estimate publication within 5 years. Features included in the analysis were principal investigator characteristics (sex, degree, and institution type) and grant characteristics (research grant mechanism, primary and secondary research topics, and amount awarded). We evaluated model performance using calibration plots and then determined the models’ discriminatory ability by estimating the area under the receiver operator curve and c-statistic. Then we used Brier scores to obtain an overall assessment of each model’s accuracy. We ultimately selected 1 model for administrative use based on its performance measures.
Results
The Bayesian generalized linear model performed best (area under the curve, 0.82 [95% CI, 0.68-0.95]; Brier score, 0.17 [95% CI, 0.10-0.23]) and therefore was selected. It showed administrative utility in decision curve analysis. Awardee features most strongly associated with publication were previous award winner (no), principal investigator specialty (anesthesiology), sex (male), degree (PhD), and institution type (university). Grant features most strongly associated with publication were primary topic (stem cell therapy and chemoprevention), secondary topic (biologics), research type (in vitro study and animal validation), award mechanism (translational research), award amount > median amount ($598,000), and award years 2010-2011.
Conclusions
This model can aid the PRORP in identifying awardees who will successfully publish, and funding agencies and policymakers likewise can use it to apportion grants in a manner that promotes diversity across the applicant pool.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Division of Orthopaedics, Department of Surgery, Walter Reed National Military Medical Center, Uniformed Services University, Bethesda, MA 20889, United States.
- Henry Jackson Foundation for the Advancement of Military Medicine, Bethesda, MA 20817, United States.
- Department of Orthopaedic Surgery, The Johns Hopkins University Hospital, Baltimore, MA 21287, United States.
ORCID-Profile: Ashley B Anderson, Jonathan A Forsberg
Zitieren
APA
Anderson, A. B., Rivera, J., Grazal, C. F., Tintle, S. M., Potter, B. K., Dickens, J. F., & Forsberg, J. A. (2025). Estimating the 5-Year Publication Potential for Grant Awardees: Analysis of the Peer Reviewed Orthopaedic Research Program. Military Medicine. https://doi.org/10.1093/milmed/usaf173
Vancouver
Anderson AB, Rivera J, Grazal CF, Tintle SM, Potter BK, Dickens JF, et al. Estimating the 5-Year Publication Potential for Grant Awardees: Analysis of the Peer Reviewed Orthopaedic Research Program. Military Medicine. 2025. doi:10.1093/milmed/usaf173
BibTeX
@article{Anderson2025,
author = {Anderson, Ashley B and Rivera, Julio and Grazal, Clare F and Tintle, Scott M and Potter, Benjamin K and Dickens, Jonathan F and Forsberg, Jonathan A},
title = {Estimating the 5-Year Publication Potential for Grant Awardees: Analysis of the Peer Reviewed Orthopaedic Research Program},
journal = {Military Medicine},
year = {2025},
doi = {10.1093/milmed/usaf173}
}
EUVIMED