BulkFormer: A large-scale foundation model for bulk transcriptomes
Cell Systems · 2026-07 · 17 (7) · 101657
DOI: 10.1016/j.cels.2026.101657 ↗Kurz gefasst
Fachartikel in der Zeitschrift Cell Systems, 2026-07. Verfasst von Boming Kang und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, State Key Laboratory of Vascular Homeostasis and Remodeling, School of Basic Medical Sciences, Peking Universit…. Hauptthemen laut MEDLINE: Transcriptome, Gene Expression Profiling. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Natural Science Foundation of China National Outstanding Youth Science Fund Project.
Abstract (Originalsprache)
Foundation models are transforming transcriptome analysis, yet most RNA sequencing (RNA-seq) foundation models are pretrained on sparse single-cell RNA-seq data, which typically captures only ∼3,000 genes per cell. This creates a need for models tailored to bulk transcriptomes, a modality that profiles ∼16,000 genes per sample and supports clinical and tissue-level analyses. Here, we present BulkFormer, a foundation model for bulk transcriptome analysis. BulkFormer contains ∼150 million parameters, covers 20,010 protein-coding genes, and is pretrained on 581,503 human bulk RNA-seq profiles. Its hybrid encoder combines a graph neural network to model explicit gene-gene relationships with a Performer module to capture global expression dependencies. Across five downstream tasks, BulkFormer outperformed existing single-cell foundation models while requiring substantially lower training cost. These results identify pretraining data modality as a key determinant of foundation model performance and establish BulkFormer as a framework for bulk transcriptome modeling. A record of this paper's transparent peer review process is included in the supplemental information.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biomedical Informatics, State Key Laboratory of Vascular Homeostasis and Remodeling, School of Basic Medical Sciences, Peking University, 38 Xueyuan Rd., Beijing 100191, China.
- School of Pharmaceutical Sciences, Jilin University, Changchun 130021, China.
- School of Sports Medicine, Wuhan Institute of Physical Education, No. 461 Luoyu Rd., Wuchang District, Wuhan 430079, Hubei, China.
- Department of Biomedical Informatics, State Key Laboratory of Vascular Homeostasis and Remodeling, School of Basic Medical Sciences, Peking University, 38 Xueyuan Rd., Beijing 100191, China; School of Sports Medicine, W…
Förderung
- National Natural Science Foundation of China
- National Natural Science Foundation of China National Outstanding Youth Science Fund Project
Zitieren
APA
Kang, B., Fan, R., Yi, M., Cui, C., & Cui, Q. (2026). BulkFormer: A large-scale foundation model for bulk transcriptomes. Cell Systems, 17(7), 101657. https://doi.org/10.1016/j.cels.2026.101657
Vancouver
Kang B, Fan R, Yi M, Cui C, Cui Q. BulkFormer: A large-scale foundation model for bulk transcriptomes. Cell Systems. 2026;17(7):101657. doi:10.1016/j.cels.2026.101657
BibTeX
@article{Kang2026,
author = {Kang, Boming and Fan, Rui and Yi, Meizheng and Cui, Chunmei and Cui, Qinghua},
title = {BulkFormer: A large-scale foundation model for bulk transcriptomes},
journal = {Cell Systems},
year = {2026},
volume = {17},
number = {7},
pages = {101657},
doi = {10.1016/j.cels.2026.101657}
}
EUVIMED