Evaluating GPT and BERT models for protein–protein interaction identification in biomedical text
Bioinformatics Advances · 05.01.2024 · 4 (1)
DOI: 10.1093/bioadv/vbae133 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bioinformatics Advances, online erschienen am 11.09.2024. Verfasst von Hasin Rehana und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, School of Electrical Engineering & Computer Science, University of North Dakota, Grand Forks, ND 58202, United States. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: U.S. National Institute of Allergy and Infectious Disease.
Abstract (Originalsprache)
Motivation Detecting protein–protein interactions (PPIs) is crucial for understanding genetic mechanisms, disease pathogenesis, and drug design. As biomedical literature continues to grow rapidly, there is an increasing need for automated and accurate extraction of these interactions to facilitate scientific discovery. Pretrained language models, such as generative pretrained transformers and bidirectional encoder representations from transformers, have shown promising results in natural language processing tasks. Results We evaluated the performance of PPI identification using multiple transformer-based models across three manually curated gold-standard corpora: Learning Language in Logic with 164 interactions in 77 sentences, Human Protein Reference Database with 163 interactions in 145 sentences, and Interaction Extraction Performance Assessment with 335 interactions in 486 sentences. Models based on bidirectional encoder representations achieved the best overall performance, with BioBERT achieving the highest recall of 91.95% and F1 score of 86.84% on the Learning Language in Logic dataset. Despite not being explicitly trained for biomedical texts, GPT-4 showed commendable performance, comparable to the bidirectional encoder models. Specifically, GPT-4 achieved the highest precision of 88.37%, a recall of 85.14%, and an F1 score of 86.49% on the same dataset. These results suggest that GPT-4 can effectively detect protein interactions from text, offering valuable applications in mining biomedical literature. Availability and implementation The source code and datasets used in this study are available at https://github.com/hurlab/PPI-GPT-BERT.
Autor:innen und Institutionen
- Department of Computer Science, School of Electrical Engineering & Computer Science, University of North Dakota, Grand Forks, ND 58202, United States.
- Department of Biomedical Sciences, School of Medicine and Health Sciences, University of North Dakota, Grand Forks, ND 58202, United States.
- Department of Computer Engineering, Bogazici University, Istanbul 34342, Turkey.
- Unit for Laboratory Animal Medicine, University of Michigan, Ann Arbor, MI 48109, United States.
- Center for Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor, MI 48109, United States.
ORCID-Profile: Hasin Rehana, Yongqun He, Junguk Hur
Förderung
- U.S. National Institute of Allergy and Infectious Disease
Zitieren
APA
Rehana, H., Çam, N. B., Basmaci, M., Zheng, J., Jemiyo, C., He, Y., Özgür, A., & Hur, J. (2024). Evaluating GPT and BERT models for protein–protein interaction identification in biomedical text. Bioinformatics Advances, 4(1). https://doi.org/10.1093/bioadv/vbae133
Vancouver
Rehana H, Çam NB, Basmaci M, Zheng J, Jemiyo C, He Y, et al. Evaluating GPT and BERT models for protein–protein interaction identification in biomedical text. Bioinformatics Advances. 2024;4(1). doi:10.1093/bioadv/vbae133
BibTeX
@article{Rehana2024,
author = {Rehana, Hasin and Çam, Nur Bengisu and Basmaci, Mert and Zheng, Jie and Jemiyo, Christianah and He, Yongqun and Özgür, Arzucan and Hur, Junguk},
title = {Evaluating GPT and BERT models for protein–protein interaction identification in biomedical text},
journal = {Bioinformatics Advances},
year = {2024},
volume = {4},
number = {1},
doi = {10.1093/bioadv/vbae133}
}
EUVIMED