EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

TExCNN: Leveraging Pre-Trained Models to Predict Gene Expression from Genomic Sequences

Guohao Dong iD, Yuqian Wu, Lan Huang iD, Fei Li iD, Fengfeng Zhou iD

Genes · 2024

DOI: 10.3390/genes15121593 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Genes, 2024. Verfasst von Guohao Dong und 4 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China. Hauptthemen laut MEDLINE: Deep Learning, Neural Networks, Computer. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background/Objectives: Understanding the relationship between DNA sequences and gene expression levels is of significant biological importance. Recent advancements have demonstrated the ability of deep learning to predict gene expression levels directly from genomic data. However, traditional methods are limited by basic word encoding techniques, which fail to capture the inherent features and patterns of DNA sequences.

Methods

We introduce TExCNN, a novel framework that integrates the pre-trained models DNABERT and DNABERT-2 to generate word embeddings for DNA sequences. We partitioned the DNA sequences into manageable segments and computed their respective embeddings using the pre-trained models. These embeddings were then utilized as inputs to our deep learning framework, which was based on convolutional neural network.

Results

TExCNN outperformed current state-of-the-art models, achieving an average R2 score of 0.622, compared to the 0.596 score achieved by the DeepLncLoc model, which is based on the Word2Vec model and a text convolutional neural network. Furthermore, when the sequence length was extended from 10,500 bp to 50,000 bp, TExCNN achieved an even higher average R2 score of 0.639. The prediction accuracy improved further when additional biological features were incorporated.

Conclusions

Our experimental results demonstrate that the use of pre-trained models for word embedding generation significantly improves the accuracy of predicting gene expression. The proposed TExCNN pipeline performes optimally with longer DNA sequences and is adaptable for both cell-type-independent and cell-type-dependent predictions.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningNeural Networks, ComputerHumansGenomicsSequence Analysis, DNASoftware

Stichwörter der Autor:innen

DNA sequencedeep learninggene expression predictionpre-trained modelregression task

Autor:innen und Institutionen

  • Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China.
  • College of Computer Science and Technology, Jilin University, Changchun 130012, China.
  • College of Software, Jilin University, Changchun 130012, China.

ORCID-Profile: Guohao Dong, Lan Huang, Fei Li, Fengfeng Zhou

Zitieren

APA

Dong, G., Wu, Y., Huang, L., Li, F., & Zhou, F. (2024). TExCNN: Leveraging Pre-Trained Models to Predict Gene Expression from Genomic Sequences. Genes. https://doi.org/10.3390/genes15121593

Vancouver

Dong G, Wu Y, Huang L, Li F, Zhou F. TExCNN: Leveraging Pre-Trained Models to Predict Gene Expression from Genomic Sequences. Genes. 2024. doi:10.3390/genes15121593

BibTeX
@article{Dong2024,
  author = {Dong, Guohao and Wu, Yuqian and Huang, Lan and Li, Fei and Zhou, Fengfeng},
  title = {TExCNN: Leveraging Pre-Trained Models to Predict Gene Expression from Genomic Sequences},
  journal = {Genes},
  year = {2024},
  doi = {10.3390/genes15121593}
}
Kostenlos starten →