EUVIMEDEUVIMED entdecken
Crossref

BulkFormer: A large-scale foundation model for bulk transcriptomes

Boming Kang, Rui Fan, Meizheng Yi, Chunmei Cui, Qinghua Cui

Cell Systems · 2026-07 · 17 (7) · 101657

DOI: 10.1016/j.cels.2026.101657 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cell Systems, 2026-07. Verfasst von Boming Kang und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, State Key Laboratory of Vascular Homeostasis and Remodeling, School of Basic Medical Sciences, Peking Universit…. Hauptthemen laut MEDLINE: Transcriptome, Gene Expression Profiling. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Natural Science Foundation of China National Outstanding Youth Science Fund Project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Foundation models are transforming transcriptome analysis, yet most RNA sequencing (RNA-seq) foundation models are pretrained on sparse single-cell RNA-seq data, which typically captures only ∼3,000 genes per cell. This creates a need for models tailored to bulk transcriptomes, a modality that profiles ∼16,000 genes per sample and supports clinical and tissue-level analyses. Here, we present BulkFormer, a foundation model for bulk transcriptome analysis. BulkFormer contains ∼150 million parameters, covers 20,010 protein-coding genes, and is pretrained on 581,503 human bulk RNA-seq profiles. Its hybrid encoder combines a graph neural network to model explicit gene-gene relationships with a Performer module to capture global expression dependencies. Across five downstream tasks, BulkFormer outperformed existing single-cell foundation models while requiring substantially lower training cost. These results identify pretraining data modality as a key determinant of foundation model performance and establish BulkFormer as a framework for bulk transcriptome modeling. A record of this paper's transparent peer review process is included in the supplemental information.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

TranscriptomeGene Expression ProfilingHumansSequence Analysis, RNAGraph Neural NetworksRNA-Seq

Stichwörter der Autor:innen

deep learningfoundation modelshuman bulk transcriptomes

Autor:innen und Institutionen

  • Department of Biomedical Informatics, State Key Laboratory of Vascular Homeostasis and Remodeling, School of Basic Medical Sciences, Peking University, 38 Xueyuan Rd., Beijing 100191, China.
  • School of Pharmaceutical Sciences, Jilin University, Changchun 130021, China.
  • School of Sports Medicine, Wuhan Institute of Physical Education, No. 461 Luoyu Rd., Wuchang District, Wuhan 430079, Hubei, China.
  • Department of Biomedical Informatics, State Key Laboratory of Vascular Homeostasis and Remodeling, School of Basic Medical Sciences, Peking University, 38 Xueyuan Rd., Beijing 100191, China; School of Sports Medicine, W…

Förderung

  • National Natural Science Foundation of China
  • National Natural Science Foundation of China National Outstanding Youth Science Fund Project

Zitieren

APA

Kang, B., Fan, R., Yi, M., Cui, C., & Cui, Q. (2026). BulkFormer: A large-scale foundation model for bulk transcriptomes. Cell Systems, 17(7), 101657. https://doi.org/10.1016/j.cels.2026.101657

Vancouver

Kang B, Fan R, Yi M, Cui C, Cui Q. BulkFormer: A large-scale foundation model for bulk transcriptomes. Cell Systems. 2026;17(7):101657. doi:10.1016/j.cels.2026.101657

BibTeX
@article{Kang2026,
  author = {Kang, Boming and Fan, Rui and Yi, Meizheng and Cui, Chunmei and Cui, Qinghua},
  title = {BulkFormer: A large-scale foundation model for bulk transcriptomes},
  journal = {Cell Systems},
  year = {2026},
  volume = {17},
  number = {7},
  pages = {101657},
  doi = {10.1016/j.cels.2026.101657}
}
Kostenlos starten →