S‐PLM: Structure‐Aware Protein Language Model via Contrastive Learning Between Sequence and Structure
Advanced Science · 2025-02 · 12 (5)
DOI: 10.1002/advs.202404212 ↗Kurz gefasst
Fachartikel in der Zeitschrift Advanced Science, online erschienen am 12.12.2024. Verfasst von Duolin Wang und 10 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical Engineering and Computer Science and Christopher S. Bond Life Sciences Center, University of Missouri, Columbia, MO, 65211, …. Hauptthemen laut MEDLINE: Proteins, Computational Biology, Machine Learning. Die Arbeit wurde bisher 41-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIGMS NIH HHS, Medicine (AIM) at the University of Kentucky, University of Kentucky Center for Computational Sciences and Information Technology Services Research Computing.
Abstract (Originalsprache)
Proteins play an essential role in various biological and engineering processes. Large protein language models (PLMs) present excellent potential to reshape protein research by accelerating the determination of protein functions and the design of proteins with the desired functions. The prediction and design capacity of PLMs relies on the representation gained from the protein sequences. However, the lack of crucial 3D structure information in most PLMs restricts the prediction capacity of PLMs in various applications, especially those heavily dependent on 3D structures. To address this issue, S‐PLM is introduced as a 3D structure‐aware PLM that utilizes multi‐view contrastive learning to align the sequence and 3D structure of a protein in a coordinated latent space. S‐PLM applies Swin‐Transformer on AlphaFold‐predicted protein structures to embed the structural information and fuses it into sequence‐based embedding from ESM2. Additionally, a library of lightweight tuning tools is provided to adapt S‐PLM for diverse downstream protein prediction tasks. The results demonstrate S‐PLM's superior performance over sequence‐only PLMs on all protein clustering and classification tasks, achieving competitiveness comparable to state‐of‐the‐art methods requiring both sequence and structure inputs. S‐PLM and its lightweight tuning tools are available at https://github.com/duolinwang/S-PLM/ .
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Department of Electrical Engineering and Computer Science and Christopher S. Bond Life Sciences Center, University of Missouri, Columbia, MO, 65211, USA.
- Chemical & Materials Engineering, University of Kentucky, Lexington, KY, 40506, USA.
- Department of Medicine and Department of Biomedical Informatics and Data Science, University of Alabama at Birmingham, Birmingham, AL, 35294, USA.
ORCID-Profile: Dong Xu
Förderung
- NIGMS NIH HHS
- Medicine (AIM) at the University of Kentucky
- University of Kentucky Center for Computational Sciences and Information Technology Services Research Computing
- National Science Foundation
- Foundation for the National Institutes of Health
- NLM NIH HHS
- NCSA
- NCI NIH HHS
Zitieren
APA
Wang, D., Pourmirzaei, M., Abbas, U. L., Zeng, S., Manshour, N., Esmaili, F., Poudel, B., Jiang, Y., Shao, Q., Chen, J., & Xu, D. (2025). S‐PLM: Structure‐Aware Protein Language Model via Contrastive Learning Between Sequence and Structure. Advanced Science, 12(5). https://doi.org/10.1002/advs.202404212
Vancouver
Wang D, Pourmirzaei M, Abbas UL, Zeng S, Manshour N, Esmaili F, et al. S‐PLM: Structure‐Aware Protein Language Model via Contrastive Learning Between Sequence and Structure. Advanced Science. 2025;12(5). doi:10.1002/advs.202404212
BibTeX
@article{Wang2025,
author = {Wang, Duolin and Pourmirzaei, Mahdi and Abbas, Usman L and Zeng, Shuai and Manshour, Negin and Esmaili, Farzaneh and Poudel, Biplab and Jiang, Yuexu and Shao, Qing and Chen, Jin and Xu, Dong},
title = {S‐PLM: Structure‐Aware Protein Language Model via Contrastive Learning Between Sequence and Structure},
journal = {Advanced Science},
year = {2025},
volume = {12},
number = {5},
doi = {10.1002/advs.202404212}
}
EUVIMED