EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

PeptideBERT: A Language Model Based on Transformers for Peptide Property Prediction

Chakradhar Guntuboina, Adrita Das, Parisa Mollaei iD, Seongwon Kim, Amir Barati Farimani iD

The Journal of Physical Chemistry Letters · 23.11.2023 · 14 (46) · 10427-10434

DOI: 10.1021/acs.jpclett.3c02398 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of Physical Chemistry Letters, online erschienen am 13.11.2023. Verfasst von Chakradhar Guntuboina und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, United States. Hauptthemen laut MEDLINE: Hemolysis, Peptides. Die Arbeit wurde bisher 133-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Department of Mechanical Engineering, Carnegie Mellon University, Center for Machine Learning in Health, Carnegie Mellon University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advances in language models have enabled the protein modeling community with a powerful tool that uses transformers to represent protein sequences as text. This breakthrough enables a sequence-to-property prediction for peptides without relying on explicit structural data. Inspired by the recent progress in the field of large language models, we present PeptideBERT, a protein language model specifically tailored for predicting essential peptide properties such as hemolysis, solubility, and nonfouling. The PeptideBERT utilizes the ProtBERT pretrained transformer model with 12 attention heads and 12 hidden layers. Through fine-tuning the pretrained model for the three downstream tasks, our model is state of the art (SOTA) in predicting hemolysis, which is crucial for determining a peptide's potential to induce red blood cells as well as nonfouling properties. Leveraging primarily shorter sequences and a data set with negative samples predominantly associated with insoluble peptides, our model showcases remarkable performance.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

HemolysisPeptidesHumansAmino Acid SequenceCell DeathLanguage

Substanzen

Peptides

Autor:innen und Institutionen

  • Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, United States.
  • Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, United States.
  • Department of Mechanical Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, United States.
  • Department of Chemical Engineering, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, United States.
  • Machine Learning Department, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, United States.

ORCID-Profile: Parisa Mollaei, Amir Barati Farimani

Förderung

  • Department of Mechanical Engineering, Carnegie Mellon University
  • Center for Machine Learning in Health, Carnegie Mellon University

Zitieren

APA

Guntuboina, C., Das, A., Mollaei, P., Kim, S., & Barati Farimani, A. (2023). PeptideBERT: A Language Model Based on Transformers for Peptide Property Prediction. The Journal of Physical Chemistry Letters, 14(46), 10427-10434. https://doi.org/10.1021/acs.jpclett.3c02398

Vancouver

Guntuboina C, Das A, Mollaei P, Kim S, Barati Farimani A. PeptideBERT: A Language Model Based on Transformers for Peptide Property Prediction. The Journal of Physical Chemistry Letters. 2023;14(46):10427-10434. doi:10.1021/acs.jpclett.3c02398

BibTeX
@article{Guntuboina2023,
  author = {Guntuboina, Chakradhar and Das, Adrita and Mollaei, Parisa and Kim, Seongwon and Barati Farimani, Amir},
  title = {PeptideBERT: A Language Model Based on Transformers for Peptide Property Prediction},
  journal = {The Journal of Physical Chemistry Letters},
  year = {2023},
  volume = {14},
  number = {46},
  pages = {10427--10434},
  doi = {10.1021/acs.jpclett.3c02398}
}
Kostenlos starten →