EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ILMCNet: A Deep Neural Network Model That Uses PLM to Process Features and Employs CRF to Predict Protein Secondary Structure

Benzhi Dong, Hui Su iD, Dali Xu, Chang Hou, Zheng Liu iD, Na Niu, Guohua Wang

Genes · 2024

DOI: 10.3390/genes15101350 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Genes, 2024. Verfasst von Benzhi Dong und 6 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer and Control Engineering, Northeast Forestry University, Harbin 150040, China. Hauptthemen laut MEDLINE: Protein Structure, Secondary, Neural Networks, Computer, Proteins, Computational Biology. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key R&D Program of Heilongjiang Province, National Natural Science Foundation of China, Key R&D Program of Heilongjiang Province.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Protein secondary structure prediction (PSSP) is a critical task in computational biology, pivotal for understanding protein function and advancing medical diagnostics. Recently, approaches that integrate multiple amino acid sequence features have gained significant attention in PSSP research.

Objectives

We aim to automatically extract additional features represented by evolutionary information from a large number of sequences while simultaneously incorporating positional information for more comprehensive sequence features. Additionally, we consider the interdependence between secondary structures during the prediction stage.

Methods

To this end, we propose a deep neural network model, ILMCNet, which utilizes a language model and Conditional Random Field (CRF). Protein language models (PLMs) pre-trained on sequences from multiple large databases can provide sequence features that incorporate evolutionary information. ILMCNet uses positional encoding to ensure that the input features include positional information. To better utilize these features, we propose a hybrid network architecture that employs a Transformer Encoder to enhance features and integrates a feature extraction module combining a Convolutional Neural Network (CNN) with a Bidirectional Long Short-Term Memory Network (BiLSTM). This design enables deep extraction of localized features while capturing global bidirectional information. In the prediction stage, ILMCNet employs CRF to capture the interdependencies between secondary structures.

Results

Experimental results on benchmark datasets such as CB513, TS115, NEW364, CASP11, and CASP12 demonstrate that the prediction performance of our method surpasses that of comparable approaches.

Conclusions

This study proposes a new approach to PSSP research and is expected to play an important role in other protein-related research fields, such as protein tertiary structure prediction.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Protein Structure, SecondaryNeural Networks, ComputerProteinsComputational BiologyDatabases, ProteinDeep LearningAlgorithmsSequence Analysis, ProteinAmino Acid Sequence

Stichwörter der Autor:innen

conditional random fieldhybrid neural network architectureprotein secondary structureunsupervised protein language model

Substanzen

Proteins

Autor:innen und Institutionen

  • College of Computer and Control Engineering, Northeast Forestry University, Harbin 150040, China.

ORCID-Profile: Hui Su, Zheng Liu

Förderung

  • Key R&D Program of Heilongjiang Province
  • National Natural Science Foundation of China
  • Key R&D Program of Heilongjiang Province

Zitieren

APA

Dong, B., Su, H., Xu, D., Hou, C., Liu, Z., Niu, N., & Wang, G. (2024). ILMCNet: A Deep Neural Network Model That Uses PLM to Process Features and Employs CRF to Predict Protein Secondary Structure. Genes. https://doi.org/10.3390/genes15101350

Vancouver

Dong B, Su H, Xu D, Hou C, Liu Z, Niu N, et al. ILMCNet: A Deep Neural Network Model That Uses PLM to Process Features and Employs CRF to Predict Protein Secondary Structure. Genes. 2024. doi:10.3390/genes15101350

BibTeX
@article{Dong2024,
  author = {Dong, Benzhi and Su, Hui and Xu, Dali and Hou, Chang and Liu, Zheng and Niu, Na and Wang, Guohua},
  title = {ILMCNet: A Deep Neural Network Model That Uses PLM to Process Features and Employs CRF to Predict Protein Secondary Structure},
  journal = {Genes},
  year = {2024},
  doi = {10.3390/genes15101350}
}
Kostenlos starten →