Prot2Chat: protein large language model with early fusion of text, sequence, and structure
Bioinformatics · 2025
DOI: 10.1093/bioinformatics/btaf396 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bioinformatics, 2025. Verfasst von Zhicong Wang und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Technology, Soochow University, Suzhou 215006, China. Hauptthemen laut MEDLINE: Proteins, Software, Computational Biology. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Motivation Proteins are of great significance in living organisms. However, understanding their functions encounters numerous challenges, such as insufficient integration of multimodal information, a large number of training parameters, limited flexibility of classification-based methods, and the lack of systematic evaluation metrics for protein question answering systems. To tackle these issues, we propose the Prot2Chat framework. Results We modified ProteinMPNN to encode protein sequence and structural information in a unified way. We used a large language model (LLM) to encode questions into vectors and developed a protein-text adapter to compress protein information into virtual tokens based on these vectors, achieving the early fusion of text and protein information. Finally, the same LLM reads the virtual tokens and the questions to generate answers. To optimize training efficiency, we froze the encoder and employed low-rank adaptation (LoRA) techniques for the LLM. Experiments on two datasets show that both automated metrics and expert evaluations demonstrate the superior performance of our model, and zero-shot prediction results highlight its generalization ability. We have developed an easy-to-use web interactive platform and a rapid installation option, allowing users to swiftly engage with Prot2Chat. Availability and implementation The models and codes are available at https://github.com/wangzc1233/Prot2Chat.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Substanzen
Autor:innen und Institutionen
- School of Computer Science and Technology, Soochow University, Suzhou 215006, China.
- Changping Laboratory, Beijing 102206, China.
ORCID-Profile: Zhicong Wang
Zitieren
APA
Wang, Z., Ma, Z., Cao, Z., Zhou, C., Zhang, J., & Gao, Y. Q. (2025). Prot2Chat: protein large language model with early fusion of text, sequence, and structure. Bioinformatics. https://doi.org/10.1093/bioinformatics/btaf396
Vancouver
Wang Z, Ma Z, Cao Z, Zhou C, Zhang J, Gao YQ. Prot2Chat: protein large language model with early fusion of text, sequence, and structure. Bioinformatics. 2025. doi:10.1093/bioinformatics/btaf396
BibTeX
@article{Wang2025,
author = {Wang, Zhicong and Ma, Zicheng and Cao, Ziqiang and Zhou, Changlong and Zhang, Jun and Gao, Yi Qin},
title = {Prot2Chat: protein large language model with early fusion of text, sequence, and structure},
journal = {Bioinformatics},
year = {2025},
doi = {10.1093/bioinformatics/btaf396}
}
EUVIMED