EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

BERT-TFBS: a novel BERT-based model for predicting transcription factor binding sites by transfer learning

Kai Wang, Xuan Zeng, Jingwen Zhou, Fei Liu, Xiaoli Luan, Xinglong Wang

Briefings in Bioinformatics · 27.03.2024 · 25 (3)

DOI: 10.1093/bib/bbae195 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Briefings in Bioinformatics, online erschienen am 02.05.2024. Verfasst von Kai Wang und 5 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University,…. Hauptthemen laut MEDLINE: Transcription Factors, Neural Networks, Computer. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, National First-class Discipline Program of Light Industry Technology and Engineering, National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Transcription factors (TFs) are proteins essential for regulating genetic transcriptions by binding to transcription factor binding sites (TFBSs) in DNA sequences. Accurate predictions of TFBSs can contribute to the design and construction of metabolic regulatory systems based on TFs. Although various deep-learning algorithms have been developed for predicting TFBSs, the prediction performance needs to be improved. This paper proposes a bidirectional encoder representations from transformers (BERT)-based model, called BERT-TFBS, to predict TFBSs solely based on DNA sequences. The model consists of a pre-trained BERT module (DNABERT-2), a convolutional neural network (CNN) module, a convolutional block attention module (CBAM) and an output module. The BERT-TFBS model utilizes the pre-trained DNABERT-2 module to acquire the complex long-term dependencies in DNA sequences through a transfer learning approach, and applies the CNN module and the CBAM to extract high-order local features. The proposed model is trained and tested based on 165 ENCODE ChIP-seq datasets. We conducted experiments with model variants, cross-cell-line validations and comparisons with other models. The experimental results demonstrate the effectiveness and generalization capability of BERT-TFBS in predicting TFBSs, and they show that the proposed model outperforms other deep-learning models. The source code for BERT-TFBS is available at https://github.com/ZX1998-12/BERT-TFBS.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Transcription FactorsNeural Networks, ComputerBinding SitesAlgorithmsComputational BiologyHumansDeep LearningProtein Binding

Stichwörter der Autor:innen

BERTattention mechanismsbioinformaticsdeep learninggene regulationtranscription factor binding sites

Substanzen

Transcription Factors

Autor:innen und Institutionen

  • Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), School of Internet of Things Engineering, Jiangnan University, 1800 Lihu Road, Wuxi, Jiangsu 214122, China.
  • Science Center for Future Foods, Jiangnan University, 1800 Lihu Road, Wuxi, Jiangsu 214122, China.
  • Key Laboratory of Industrial Biotechnology, Ministry of Education and School of Biotechnology, Jiangnan University, 1800 Lihu Road, Wuxi, Jiangsu 214122, China.
  • Engineering Research Center of Ministry of Education on Food Synthetic Biotechnology, Jiangnan University, 1800 Lihu Road, Wuxi, Jiangsu 214122, China.
  • Jiangsu Province Engineering Research Center of Food Synthetic Biotechnology, Jiangnan University, Wuxi 214122, China.

Förderung

  • National Key Research and Development Program of China
  • National First-class Discipline Program of Light Industry Technology and Engineering
  • National Natural Science Foundation of China
  • China Postdoctoral Science Foundation

Zitieren

APA

Wang, K., Zeng, X., Zhou, J., Liu, F., Luan, X., & Wang, X. (2024). BERT-TFBS: a novel BERT-based model for predicting transcription factor binding sites by transfer learning. Briefings in Bioinformatics, 25(3). https://doi.org/10.1093/bib/bbae195

Vancouver

Wang K, Zeng X, Zhou J, Liu F, Luan X, Wang X. BERT-TFBS: a novel BERT-based model for predicting transcription factor binding sites by transfer learning. Briefings in Bioinformatics. 2024;25(3). doi:10.1093/bib/bbae195

BibTeX
@article{Wang2024,
  author = {Wang, Kai and Zeng, Xuan and Zhou, Jingwen and Liu, Fei and Luan, Xiaoli and Wang, Xinglong},
  title = {BERT-TFBS: a novel BERT-based model for predicting transcription factor binding sites by transfer learning},
  journal = {Briefings in Bioinformatics},
  year = {2024},
  volume = {25},
  number = {3},
  doi = {10.1093/bib/bbae195}
}
Kostenlos starten →