Characterization and automated classification of sentences in the biomedical literature: a case study for biocuration of gene expression and protein kinase activity
Database · 2025-01-18 · 2025
DOI: 10.1093/database/baaf063 ↗At a glance
Journal article in Database, published online on 2025-09-30. Written by Daniela Raciti and 5 co-authors. Institution: Division of Biology and Biological Engineering, California Institute of Technology, 1200 E. California Boulevard, Pasadena, CA 91125, United States. Major MEDLINE topics: Data Curation, Protein Kinases, Gene Expression, Data Mining. Cited 5 times so far (Crossref); 50 references. The full text is freely available (open access, CC BY 4.0). Funded by: NHGRI NIH HHS, NLM NIH HHS, NIH HHS.
Abstract (original language)
Biological knowledgebases are essential resources for biomedical researchers, providing ready access to gene function and genomic data. Professional, manual curation of knowledgebases, however, is labour-intensive and thus high-performing machine learning (ML) methods that improve biocuration efficiency are needed. Here, we report on sentence-level classification to identify biocuration-relevant sentences in the full text of published references for two gene function data types: gene expression and protein kinase activity. We performed a detailed characterization of sentences from references in the WormBase bibliography and used this characterization to define three tasks for classifying sentences as either (i) fully curatable, (ii) fully and partially curatable, or (iii) all language-related. We evaluated various ML models applied to these tasks and found that GPT and BioBERT achieve the highest average performance, resulting in F1 performance scores ranging from 0.89 to 0.99 depending upon the task. Moreover, our inter-annotator agreement analyses and curator timing exercises demonstrated that curators readily converged on classification of high-quality training sentences that take a relatively short period of time to collect, making expansion of this approach to other data types a realistic addition to existing biocuration workflows. Our findings demonstrate the feasibility of extracting biocuration-relevant sentences from full text. Integrating these models into professional biocuration workflows, such as those used by the Alliance of Genome Resources and the ACKnowledge community curation platform, might well facilitate efficient and accurate annotation of the biomedical literature.
Subjects
MeSH terms (MEDLINE)
Substances
Authors and institutions
- Division of Biology and Biological Engineering, California Institute of Technology, 1200 E. California Boulevard, Pasadena, CA 91125, United States.
- The Jackson Laboratory, 600 Main Street, Bar Harbor, ME 04609, United States.
ORCID profiles: Daniela Raciti, Kimberly M Van Auken, Valerio Arnaboldi, Christopher J Tabone, Hans-Michael Muller, Paul W Sternberg
Funding
- NHGRI NIH HHS
- NLM NIH HHS
- NIH HHS
- National Library of Medicine
- National Institutes of Health
- National Human Genome Research Institute
Cite
APA
Raciti, D., Van Auken, K. M., Arnaboldi, V., Tabone, C. J., Muller, H. M., & Sternberg, P. W. (2025). Characterization and automated classification of sentences in the biomedical literature: a case study for biocuration of gene expression and protein kinase activity. Database, 2025. https://doi.org/10.1093/database/baaf063
Vancouver
Raciti D, Van Auken KM, Arnaboldi V, Tabone CJ, Muller HM, Sternberg PW. Characterization and automated classification of sentences in the biomedical literature: a case study for biocuration of gene expression and protein kinase activity. Database. 2025;2025. doi:10.1093/database/baaf063
BibTeX
@article{Raciti2025,
author = {Raciti, Daniela and Van Auken, Kimberly M and Arnaboldi, Valerio and Tabone, Christopher J and Muller, Hans-Michael and Sternberg, Paul W},
title = {Characterization and automated classification of sentences in the biomedical literature: a case study for biocuration of gene expression and protein kinase activity},
journal = {Database},
year = {2025},
volume = {2025},
doi = {10.1093/database/baaf063}
}
EUVIMED