PeptideBERT: A Language Model Based on Transformers for Peptide Property Prediction
The Journal of Physical Chemistry Letters · 23.11.2023 · 14 (46) · 10427-10434
DOI: 10.1021/acs.jpclett.3c02398 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of Physical Chemistry Letters, online erschienen am 13.11.2023. Verfasst von Chakradhar Guntuboina und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, United States. Hauptthemen laut MEDLINE: Hemolysis, Peptides. Die Arbeit wurde bisher 133-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Department of Mechanical Engineering, Carnegie Mellon University, Center for Machine Learning in Health, Carnegie Mellon University.
Abstract (Originalsprache)
Recent advances in language models have enabled the protein modeling community with a powerful tool that uses transformers to represent protein sequences as text. This breakthrough enables a sequence-to-property prediction for peptides without relying on explicit structural data. Inspired by the recent progress in the field of large language models, we present PeptideBERT, a protein language model specifically tailored for predicting essential peptide properties such as hemolysis, solubility, and nonfouling. The PeptideBERT utilizes the ProtBERT pretrained transformer model with 12 attention heads and 12 hidden layers. Through fine-tuning the pretrained model for the three downstream tasks, our model is state of the art (SOTA) in predicting hemolysis, which is crucial for determining a peptide's potential to induce red blood cells as well as nonfouling properties. Leveraging primarily shorter sequences and a data set with negative samples predominantly associated with insoluble peptides, our model showcases remarkable performance.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Substanzen
Autor:innen und Institutionen
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, United States.
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, United States.
- Department of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, United States.
- Department of Chemical Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, United States.
- Machine Learning Department, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, United States.
ORCID-Profile: Parisa Mollaei, Amir Barati Farimani
Förderung
- Department of Mechanical Engineering, Carnegie Mellon University
- Center for Machine Learning in Health, Carnegie Mellon University
Zitieren
APA
Guntuboina, C., Das, A., Mollaei, P., Kim, S., & Barati Farimani, A. (2023). PeptideBERT: A Language Model Based on Transformers for Peptide Property Prediction. The Journal of Physical Chemistry Letters, 14(46), 10427-10434. https://doi.org/10.1021/acs.jpclett.3c02398
Vancouver
Guntuboina C, Das A, Mollaei P, Kim S, Barati Farimani A. PeptideBERT: A Language Model Based on Transformers for Peptide Property Prediction. The Journal of Physical Chemistry Letters. 2023;14(46):10427-10434. doi:10.1021/acs.jpclett.3c02398
BibTeX
@article{Guntuboina2023,
author = {Guntuboina, Chakradhar and Das, Adrita and Mollaei, Parisa and Kim, Seongwon and Barati Farimani, Amir},
title = {PeptideBERT: A Language Model Based on Transformers for Peptide Property Prediction},
journal = {The Journal of Physical Chemistry Letters},
year = {2023},
volume = {14},
number = {46},
pages = {10427--10434},
doi = {10.1021/acs.jpclett.3c02398}
}
EUVIMED