TExCNN: Leveraging Pre-Trained Models to Predict Gene Expression from Genomic Sequences
Genes · 2024
DOI: 10.3390/genes15121593 ↗Kurz gefasst
Fachartikel in der Zeitschrift Genes, 2024. Verfasst von Guohao Dong und 4 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China. Hauptthemen laut MEDLINE: Deep Learning, Neural Networks, Computer. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background/Objectives: Understanding the relationship between DNA sequences and gene expression levels is of significant biological importance. Recent advancements have demonstrated the ability of deep learning to predict gene expression levels directly from genomic data. However, traditional methods are limited by basic word encoding techniques, which fail to capture the inherent features and patterns of DNA sequences.
Methods
We introduce TExCNN, a novel framework that integrates the pre-trained models DNABERT and DNABERT-2 to generate word embeddings for DNA sequences. We partitioned the DNA sequences into manageable segments and computed their respective embeddings using the pre-trained models. These embeddings were then utilized as inputs to our deep learning framework, which was based on convolutional neural network.
Results
TExCNN outperformed current state-of-the-art models, achieving an average R2 score of 0.622, compared to the 0.596 score achieved by the DeepLncLoc model, which is based on the Word2Vec model and a text convolutional neural network. Furthermore, when the sequence length was extended from 10,500 bp to 50,000 bp, TExCNN achieved an even higher average R2 score of 0.639. The prediction accuracy improved further when additional biological features were incorporated.
Conclusions
Our experimental results demonstrate that the use of pre-trained models for word embedding generation significantly improves the accuracy of predicting gene expression. The proposed TExCNN pipeline performes optimally with longer DNA sequences and is adaptable for both cell-type-independent and cell-type-dependent predictions.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China.
- College of Computer Science and Technology, Jilin University, Changchun 130012, China.
- College of Software, Jilin University, Changchun 130012, China.
ORCID-Profile: Guohao Dong, Lan Huang, Fei Li, Fengfeng Zhou
Zitieren
APA
Dong, G., Wu, Y., Huang, L., Li, F., & Zhou, F. (2024). TExCNN: Leveraging Pre-Trained Models to Predict Gene Expression from Genomic Sequences. Genes. https://doi.org/10.3390/genes15121593
Vancouver
Dong G, Wu Y, Huang L, Li F, Zhou F. TExCNN: Leveraging Pre-Trained Models to Predict Gene Expression from Genomic Sequences. Genes. 2024. doi:10.3390/genes15121593
BibTeX
@article{Dong2024,
author = {Dong, Guohao and Wu, Yuqian and Huang, Lan and Li, Fei and Zhou, Fengfeng},
title = {TExCNN: Leveraging Pre-Trained Models to Predict Gene Expression from Genomic Sequences},
journal = {Genes},
year = {2024},
doi = {10.3390/genes15121593}
}
EUVIMED