EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

Transformers for single-cell RNA sequencing: a survey

Tianxing Hu, Zhi Wei

Briefings in Bioinformatics · 04.05.2026 · 27 (3)

DOI: 10.1093/bib/bbag332 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Briefings in Bioinformatics, online erschienen am 29.06.2026. Verfasst von Tianxing Hu und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, New Jersey Institute of Technology, Guttenberg Information Technologies Center (GITC), Suite 4100, University Heights…. Hauptthemen laut MEDLINE: Single-Cell Analysis, Sequence Analysis, RNA, Deep Learning. Die Arbeit nennt 80 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NHGRI NIH HHS, NIGMS NIH HHS, NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Transformers have demonstrated remarkable success in the field of deep learning, attracting significant attention from researchers and driving investigations into their applications in biomedical data analysis. Single-cell RNA sequencing (scRNA-seq) is an emerging resource important for research on disease progression and tumor microenvironments. However, scRNA-seq datasets are characterized by challenges including sparseness, high-dimensionality, large-scale, and sensitivity to batch effects. These features often necessitate substantial computational resources and can drag the performance of conventional neural networks, which frequently fail to deliver satisfactory results. The application of Transformers to single-cell sequencing is promising to solve these problems, and due to its self-attention mechanism and transfer learning paradigm, Transformers have significantly improved its model performance. This survey aims to provide a comprehensive overview of Transformers applied to scRNA-seq. It systematically analyzes the construction and capacity of Transformers in two fields: (i) Transformers designed for specific tasks, and (ii) Transformers developed to address multiple downstream tasks, often referred to as foundation models. In addition, this work examines Transformer models from the perspectives of performance, computational efficiency, interpretability, and scalability, and outlines potential avenues for future research, including emerging efforts on other omics layers beyond scRNA-seq. By offering a detailed analysis, we aim to provide a practical resource for both newcomers and experienced researchers, push forward the development of Transformer-based models for single-cell sequencing, address current challenges, and inspire further progress in the field.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Single-Cell AnalysisSequence Analysis, RNADeep LearningHumansSingle-Cell Gene Expression AnalysisTransfer Machine Learning

Stichwörter der Autor:innen

deep learningself-attentionsingle-cell RNA sequencingtransfer learningtransformer

Autor:innen und Institutionen

  • Department of Computer Science, New Jersey Institute of Technology, Guttenberg Information Technologies Center (GITC), Suite 4100, University Heights, Newark, New Jersey 07102, USA.

Förderung

  • NHGRI NIH HHS
  • NIGMS NIH HHS
  • NIH HHS
  • National Institutes of Health

Zitieren

APA

Hu, T., & Wei, Z. (2026). Transformers for single-cell RNA sequencing: a survey. Briefings in Bioinformatics, 27(3). https://doi.org/10.1093/bib/bbag332

Vancouver

Hu T, Wei Z. Transformers for single-cell RNA sequencing: a survey. Briefings in Bioinformatics. 2026;27(3). doi:10.1093/bib/bbag332

BibTeX
@article{Hu2026,
  author = {Hu, Tianxing and Wei, Zhi},
  title = {Transformers for single-cell RNA sequencing: a survey},
  journal = {Briefings in Bioinformatics},
  year = {2026},
  volume = {27},
  number = {3},
  doi = {10.1093/bib/bbag332}
}
Kostenlos starten →