BERT-TFBS: a novel BERT-based model for predicting transcription factor binding sites by transfer learning
Briefings in Bioinformatics · 27.03.2024 · 25 (3)
DOI: 10.1093/bib/bbae195 ↗Kurz gefasst
Fachartikel in der Zeitschrift Briefings in Bioinformatics, online erschienen am 02.05.2024. Verfasst von Kai Wang und 5 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University,…. Hauptthemen laut MEDLINE: Transcription Factors, Neural Networks, Computer. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, National First-class Discipline Program of Light Industry Technology and Engineering, National Natural Science Foundation of China.
Abstract (Originalsprache)
Transcription factors (TFs) are proteins essential for regulating genetic transcriptions by binding to transcription factor binding sites (TFBSs) in DNA sequences. Accurate predictions of TFBSs can contribute to the design and construction of metabolic regulatory systems based on TFs. Although various deep-learning algorithms have been developed for predicting TFBSs, the prediction performance needs to be improved. This paper proposes a bidirectional encoder representations from transformers (BERT)-based model, called BERT-TFBS, to predict TFBSs solely based on DNA sequences. The model consists of a pre-trained BERT module (DNABERT-2), a convolutional neural network (CNN) module, a convolutional block attention module (CBAM) and an output module. The BERT-TFBS model utilizes the pre-trained DNABERT-2 module to acquire the complex long-term dependencies in DNA sequences through a transfer learning approach, and applies the CNN module and the CBAM to extract high-order local features. The proposed model is trained and tested based on 165 ENCODE ChIP-seq datasets. We conducted experiments with model variants, cross-cell-line validations and comparisons with other models. The experimental results demonstrate the effectiveness and generalization capability of BERT-TFBS in predicting TFBSs, and they show that the proposed model outperforms other deep-learning models. The source code for BERT-TFBS is available at https://github.com/ZX1998-12/BERT-TFBS.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University, 1800 Lihu Road, Wuxi, Jiangsu 214122, China.
- Science Center for Future Foods, Jiangnan University, 1800 Lihu Road, Wuxi, Jiangsu 214122, China.
- Key Laboratory of Industrial Biotechnology, Ministry of Education and School of Biotechnology, Jiangnan University, 1800 Lihu Road, Wuxi, Jiangsu 214122, China.
- Engineering Research Center of Ministry of Education on Food Synthetic Biotechnology, Jiangnan University, 1800 Lihu Road, Wuxi, Jiangsu 214122, China.
- Jiangsu Province Engineering Research Center of Food Synthetic Biotechnology, Jiangnan University, Wuxi 214122, China.
Förderung
- National Key Research and Development Program of China
- National First-class Discipline Program of Light Industry Technology and Engineering
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
Zitieren
APA
Wang, K., Zeng, X., Zhou, J., Liu, F., Luan, X., & Wang, X. (2024). BERT-TFBS: a novel BERT-based model for predicting transcription factor binding sites by transfer learning. Briefings in Bioinformatics, 25(3). https://doi.org/10.1093/bib/bbae195
Vancouver
Wang K, Zeng X, Zhou J, Liu F, Luan X, Wang X. BERT-TFBS: a novel BERT-based model for predicting transcription factor binding sites by transfer learning. Briefings in Bioinformatics. 2024;25(3). doi:10.1093/bib/bbae195
BibTeX
@article{Wang2024,
author = {Wang, Kai and Zeng, Xuan and Zhou, Jingwen and Liu, Fei and Luan, Xiaoli and Wang, Xinglong},
title = {BERT-TFBS: a novel BERT-based model for predicting transcription factor binding sites by transfer learning},
journal = {Briefings in Bioinformatics},
year = {2024},
volume = {25},
number = {3},
doi = {10.1093/bib/bbae195}
}
EUVIMED