Transformers for single-cell RNA sequencing: a survey
Briefings in Bioinformatics · 04.05.2026 · 27 (3)
DOI: 10.1093/bib/bbag332 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Briefings in Bioinformatics, online erschienen am 29.06.2026. Verfasst von Tianxing Hu und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, New Jersey Institute of Technology, Guttenberg Information Technologies Center (GITC), Suite 4100, University Heights…. Hauptthemen laut MEDLINE: Single-Cell Analysis, Sequence Analysis, RNA, Deep Learning. Die Arbeit nennt 80 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NHGRI NIH HHS, NIGMS NIH HHS, NIH HHS.
Abstract (Originalsprache)
Transformers have demonstrated remarkable success in the field of deep learning, attracting significant attention from researchers and driving investigations into their applications in biomedical data analysis. Single-cell RNA sequencing (scRNA-seq) is an emerging resource important for research on disease progression and tumor microenvironments. However, scRNA-seq datasets are characterized by challenges including sparseness, high-dimensionality, large-scale, and sensitivity to batch effects. These features often necessitate substantial computational resources and can drag the performance of conventional neural networks, which frequently fail to deliver satisfactory results. The application of Transformers to single-cell sequencing is promising to solve these problems, and due to its self-attention mechanism and transfer learning paradigm, Transformers have significantly improved its model performance. This survey aims to provide a comprehensive overview of Transformers applied to scRNA-seq. It systematically analyzes the construction and capacity of Transformers in two fields: (i) Transformers designed for specific tasks, and (ii) Transformers developed to address multiple downstream tasks, often referred to as foundation models. In addition, this work examines Transformer models from the perspectives of performance, computational efficiency, interpretability, and scalability, and outlines potential avenues for future research, including emerging efforts on other omics layers beyond scRNA-seq. By offering a detailed analysis, we aim to provide a practical resource for both newcomers and experienced researchers, push forward the development of Transformer-based models for single-cell sequencing, address current challenges, and inspire further progress in the field.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer Science, New Jersey Institute of Technology, Guttenberg Information Technologies Center (GITC), Suite 4100, University Heights, Newark, New Jersey 07102, USA.
Förderung
- NHGRI NIH HHS
- NIGMS NIH HHS
- NIH HHS
- National Institutes of Health
Zitieren
APA
Hu, T., & Wei, Z. (2026). Transformers for single-cell RNA sequencing: a survey. Briefings in Bioinformatics, 27(3). https://doi.org/10.1093/bib/bbag332
Vancouver
Hu T, Wei Z. Transformers for single-cell RNA sequencing: a survey. Briefings in Bioinformatics. 2026;27(3). doi:10.1093/bib/bbag332
BibTeX
@article{Hu2026,
author = {Hu, Tianxing and Wei, Zhi},
title = {Transformers for single-cell RNA sequencing: a survey},
journal = {Briefings in Bioinformatics},
year = {2026},
volume = {27},
number = {3},
doi = {10.1093/bib/bbag332}
}
EUVIMED