Self-supervised learning on millions of primary RNA sequences from 72 vertebrates improves sequence-based RNA splicing prediction
Briefings in Bioinformatics · 27.03.2024 · 25 (3)
DOI: 10.1093/bib/bbae163 ↗Kurz gefasst
Fachartikel in der Zeitschrift Briefings in Bioinformatics, online erschienen am 11.04.2024. Verfasst von Ken Chen und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China. Hauptthemen laut MEDLINE: RNA Splicing, Vertebrates. Die Arbeit wurde bisher 81-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key R&D Program of China, National Natural Science Foundation of China, R&D Program of Guangzhou Laboratory.
Abstract (Originalsprache)
Language models pretrained by self-supervised learning (SSL) have been widely utilized to study protein sequences, while few models were developed for genomic sequences and were limited to single species. Due to the lack of genomes from different species, these models cannot effectively leverage evolutionary information. In this study, we have developed SpliceBERT, a language model pretrained on primary ribonucleic acids (RNA) sequences from 72 vertebrates by masked language modeling, and applied it to sequence-based modeling of RNA splicing. Pretraining SpliceBERT on diverse species enables effective identification of evolutionarily conserved elements. Meanwhile, the learned hidden states and attention weights can characterize the biological properties of splice sites. As a result, SpliceBERT was shown effective on several downstream tasks: zero-shot prediction of variant effects on splicing, prediction of branchpoints in humans, and cross-species prediction of splice sites. Our study highlighted the importance of pretraining genomic language models on a diverse range of species and suggested that SSL is a promising approach to enhance our understanding of the regulatory logic underlying genomic sequences.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China.
- Peng Cheng Laboratory, Shenzhen, China.
- Key Laboratory of Machine Intelligence and Advanced Computing (Sun Yat-sen University), Ministry of Education, China.
ORCID-Profile: Ken Chen, Yue Zhou, Maolin Ding, Yu Wang, Zhixiang Ren, Yuedong Yang
Förderung
- National Key R&D Program of China
- National Natural Science Foundation of China
- R&D Program of Guangzhou Laboratory
- Peng Cheng Laboratory
- Peng Cheng Cloud-Brain
Zitieren
APA
Chen, K., Zhou, Y., Ding, M., Wang, Y., Ren, Z., & Yang, Y. (2024). Self-supervised learning on millions of primary RNA sequences from 72 vertebrates improves sequence-based RNA splicing prediction. Briefings in Bioinformatics, 25(3). https://doi.org/10.1093/bib/bbae163
Vancouver
Chen K, Zhou Y, Ding M, Wang Y, Ren Z, Yang Y. Self-supervised learning on millions of primary RNA sequences from 72 vertebrates improves sequence-based RNA splicing prediction. Briefings in Bioinformatics. 2024;25(3). doi:10.1093/bib/bbae163
BibTeX
@article{Chen2024,
author = {Chen, Ken and Zhou, Yue and Ding, Maolin and Wang, Yu and Ren, Zhixiang and Yang, Yuedong},
title = {Self-supervised learning on millions of primary RNA sequences from 72 vertebrates improves sequence-based RNA splicing prediction},
journal = {Briefings in Bioinformatics},
year = {2024},
volume = {25},
number = {3},
doi = {10.1093/bib/bbae163}
}
EUVIMED