Transformer-Based Single-Cell Language Model: A Survey
Big Data Mining and Analytics · 2024-12 · 7 (4) · 1169-1186
DOI: 10.26599/bdma.2024.9020034 ↗Kurz gefasst
Fachartikel in der Zeitschrift Big Data Mining and Analytics, 2024-12. Verfasst von Wei Lan und 5 weiteren Autor:innen. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 110 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Guangxi, Natural Science and Technology Innovation Development Foundation of Guangxi University.
Abstract (Originalsprache)
The transformers have achieved significant accomplishments in the natural language processing as its outstanding parallel processing capabilities and highly flexible attention mechanism. In addition, increasing studies based on transformers have been proposed to model single-cell data. In this review, we attempt to systematically summarize the single-cell language models and applications based on transformers. First, we provide a detailed introduction about the structures and principles of transformers. Then, we review the single-cell language models and large language models for single-cell data analysis. Moreover, we explore the datasets and applications of single-cell language models in downstream tasks, such as batch correction, cell clustering, cell type annotation, gene regulatory network inference, and perturbation response. Further, we discuss the challenges of single-cell language models and provide promising research directions. We hope this review will serve as an up-to-date reference for researchers who are interested in the direction of single-cell language models.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Guangxi
- Natural Science and Technology Innovation Development Foundation of Guangxi University
Zitieren
APA
Lan, W., He, G., Liu, M., Chen, Q., Cao, J., & Peng, W. (2024). Transformer-Based Single-Cell Language Model: A Survey. Big Data Mining and Analytics, 7(4), 1169-1186. https://doi.org/10.26599/bdma.2024.9020034
Vancouver
Lan W, He G, Liu M, Chen Q, Cao J, Peng W. Transformer-Based Single-Cell Language Model: A Survey. Big Data Mining and Analytics. 2024;7(4):1169-1186. doi:10.26599/bdma.2024.9020034
BibTeX
@article{Lan2024,
author = {Lan, Wei and He, Guohang and Liu, Mingyang and Chen, Qingfeng and Cao, Junyue and Peng, Wei},
title = {Transformer-Based Single-Cell Language Model: A Survey},
journal = {Big Data Mining and Analytics},
year = {2024},
volume = {7},
number = {4},
pages = {1169--1186},
doi = {10.26599/bdma.2024.9020034}
}
EUVIMED