EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

S‐PLM: Structure‐Aware Protein Language Model via Contrastive Learning Between Sequence and Structure

Duolin Wang, Mahdi Pourmirzaei, Usman L Abbas, Shuai Zeng, Negin Manshour, Farzaneh Esmaili, Biplab Poudel, Yuexu Jiang, Qing Shao, Jin Chen, Dong Xu iD

Advanced Science · 2025-02 · 12 (5)

DOI: 10.1002/advs.202404212 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Advanced Science, online erschienen am 12.12.2024. Verfasst von Duolin Wang und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical Engineering and Computer Science and Christopher S. Bond Life Sciences Center, University of Missouri, Columbia, MO, 65211, …. Hauptthemen laut MEDLINE: Proteins, Computational Biology, Machine Learning. Die Arbeit wurde bisher 41-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIGMS NIH HHS, Medicine (AIM) at the University of Kentucky, University of Kentucky Center for Computational Sciences and Information Technology Services Research Computing.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Proteins play an essential role in various biological and engineering processes. Large protein language models (PLMs) present excellent potential to reshape protein research by accelerating the determination of protein functions and the design of proteins with the desired functions. The prediction and design capacity of PLMs relies on the representation gained from the protein sequences. However, the lack of crucial 3D structure information in most PLMs restricts the prediction capacity of PLMs in various applications, especially those heavily dependent on 3D structures. To address this issue, S‐PLM is introduced as a 3D structure‐aware PLM that utilizes multi‐view contrastive learning to align the sequence and 3D structure of a protein in a coordinated latent space. S‐PLM applies Swin‐Transformer on AlphaFold‐predicted protein structures to embed the structural information and fuses it into sequence‐based embedding from ESM2. Additionally, a library of lightweight tuning tools is provided to adapt S‐PLM for diverse downstream protein prediction tasks. The results demonstrate S‐PLM's superior performance over sequence‐only PLMs on all protein clustering and classification tasks, achieving competitiveness comparable to state‐of‐the‐art methods requiring both sequence and structure inputs. S‐PLM and its lightweight tuning tools are available at https://github.com/duolinwang/S-PLM/ .

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ProteinsComputational BiologyMachine LearningProtein Conformation

Stichwörter der Autor:innen

contrastive learningdeep learningprotein function predictionprotein language modelprotein structure

Substanzen

Proteins

Autor:innen und Institutionen

  • Department of Electrical Engineering and Computer Science and Christopher S. Bond Life Sciences Center, University of Missouri, Columbia, MO, 65211, USA.
  • Chemical & Materials Engineering, University of Kentucky, Lexington, KY, 40506, USA.
  • Department of Medicine and Department of Biomedical Informatics and Data Science, University of Alabama at Birmingham, Birmingham, AL, 35294, USA.

ORCID-Profile: Dong Xu

Förderung

  • NIGMS NIH HHS
  • Medicine (AIM) at the University of Kentucky
  • University of Kentucky Center for Computational Sciences and Information Technology Services Research Computing
  • National Science Foundation
  • Foundation for the National Institutes of Health
  • NLM NIH HHS
  • NCSA
  • NCI NIH HHS

Zitieren

APA

Wang, D., Pourmirzaei, M., Abbas, U. L., Zeng, S., Manshour, N., Esmaili, F., Poudel, B., Jiang, Y., Shao, Q., Chen, J., & Xu, D. (2025). S‐PLM: Structure‐Aware Protein Language Model via Contrastive Learning Between Sequence and Structure. Advanced Science, 12(5). https://doi.org/10.1002/advs.202404212

Vancouver

Wang D, Pourmirzaei M, Abbas UL, Zeng S, Manshour N, Esmaili F, et al. S‐PLM: Structure‐Aware Protein Language Model via Contrastive Learning Between Sequence and Structure. Advanced Science. 2025;12(5). doi:10.1002/advs.202404212

BibTeX
@article{Wang2025,
  author = {Wang, Duolin and Pourmirzaei, Mahdi and Abbas, Usman L and Zeng, Shuai and Manshour, Negin and Esmaili, Farzaneh and Poudel, Biplab and Jiang, Yuexu and Shao, Qing and Chen, Jin and Xu, Dong},
  title = {S‐PLM: Structure‐Aware Protein Language Model via Contrastive Learning Between Sequence and Structure},
  journal = {Advanced Science},
  year = {2025},
  volume = {12},
  number = {5},
  doi = {10.1002/advs.202404212}
}
Kostenlos starten →