EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

LMCrot: an enhanced protein crotonylation site predictor by leveraging an interpretable window-level embedding from a transformer-based protein language model

Pawel Pratyush iD, Soufia Bahmani, Suresh Pokharel, Hamid D Ismail, Dukka B Kc iD

Bioinformatics · 2024

DOI: 10.1093/bioinformatics/btae290 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioinformatics, 2024. Verfasst von Pawel Pratyush und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, Michigan Technological University, Houghton, MI 49931, United States. Hauptthemen laut MEDLINE: Proteins. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Motivation Recent advancements in natural language processing have highlighted the effectiveness of global contextualized representations from protein language models (pLMs) in numerous downstream tasks. Nonetheless, strategies to encode the site-of-interest leveraging pLMs for per-residue prediction tasks, such as crotonylation (Kcr) prediction, remain largely uncharted. Results Herein, we adopt a range of approaches for utilizing pLMs by experimenting with different input sequence types (full-length protein sequence versus window sequence), assessing the implications of utilizing per-residue embedding of the site-of-interest as well as embeddings of window residues centered around it. Building upon these insights, we developed a novel residual ConvBiLSTM network designed to process window-level embeddings of the site-of-interest generated by the ProtT5-XL-UniRef50 pLM using full-length sequences as input. This model, termed T5ResConvBiLSTM, surpasses existing state-of-the-art Kcr predictors in performance across three diverse datasets. To validate our approach of utilizing full sequence-based window-level embeddings, we also delved into the interpretability of ProtT5-derived embedding tensors in two ways: firstly, by scrutinizing the attention weights obtained from the transformer’s encoder block; and secondly, by computing SHAP values for these tensors, providing a model-agnostic interpretation of the prediction results. Additionally, we enhance the latent representation of ProtT5 by incorporating two additional local representations, one derived from amino acid properties and the other from supervised embedding layer, through an intermediate fusion stacked generalization approach, using an n-mer window sequence (or, peptide/fragment). The resultant stacked model, dubbed LMCrot, exhibits a more pronounced improvement in predictive performance across the tested datasets. Availability and implementation LMCrot is publicly available at https://github.com/KCLabMTU/LMCrot.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ProteinsNatural Language ProcessingComputational BiologyDatabases, ProteinSoftwareProtein Processing, Post-TranslationalAmino Acid Sequence

Substanzen

Proteins

Autor:innen und Institutionen

  • Department of Computer Science, Michigan Technological University, Houghton, MI 49931, United States.

ORCID-Profile: Pawel Pratyush, Dukka B Kc

Förderung

  • National Science Foundation

Zitieren

APA

Pratyush, P., Bahmani, S., Pokharel, S., Ismail, H. D., & Kc, D. B. (2024). LMCrot: an enhanced protein crotonylation site predictor by leveraging an interpretable window-level embedding from a transformer-based protein language model. Bioinformatics. https://doi.org/10.1093/bioinformatics/btae290

Vancouver

Pratyush P, Bahmani S, Pokharel S, Ismail HD, Kc DB. LMCrot: an enhanced protein crotonylation site predictor by leveraging an interpretable window-level embedding from a transformer-based protein language model. Bioinformatics. 2024. doi:10.1093/bioinformatics/btae290

BibTeX
@article{Pratyush2024,
  author = {Pratyush, Pawel and Bahmani, Soufia and Pokharel, Suresh and Ismail, Hamid D and Kc, Dukka B},
  title = {LMCrot: an enhanced protein crotonylation site predictor by leveraging an interpretable window-level embedding from a transformer-based protein language model},
  journal = {Bioinformatics},
  year = {2024},
  doi = {10.1093/bioinformatics/btae290}
}
Kostenlos starten →