CytoFormer: a molecularly supervised cell foundation model for histopathology cell classification
Precision Pathology · 2026-07 · 1 (2) · 100006
DOI: 10.1016/j.prpath.2026.100006 ↗Kurz gefasst
Fachartikel in der Zeitschrift Precision Pathology, 2026-07. Verfasst von Jialu Yao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Pennsylvania Perelman School of Medicine, University of Pennsylvania Abramson Family Cancer Research Institute.
Abstract (Originalsprache)
Identifying cell types directly from routine haematoxylin and eosin (H&E) histology would enable single-cell analysis at scale, but training such models has relied on manual pathologist annotations, which are slow, expensive and unreliable for many cell types. We instead supervise morphology with molecules. Imaging-based spatial transcriptomics profiles individual cells in situ on a section that can afterwards be stained with H&E, so that molecular identity and morphology are observed for the same physical cell. We assembled 81 such paired Xenium sections spanning 16 organs, derived per-cell labels by clustering, marker-gene annotation, organ-wise human review and quality control, and mapped them onto the cell types commonly reported in each organ. This yielded 15.4 million cells, each with a paired H&E image patch and one of 23 cell types, on which we trained CytoFormer, a cell foundation model with a multi-task, per-organ classification head. On spatially held-out tissue CytoFormer reached an accuracy of 0.85 and a macro-F1 of 0.78 across all 16 organs, and its predictions reproduced the tissue architecture of an entire held-out section. The representation also transfers: with the encoder frozen, a linear head on CytoFormer features performed better than six pathology foundation models on four expert-annotated benchmarks, including on organs and cell types that were not part of pretraining. Finally, in an interactive active-learning setting, CytoFormer’s embeddings are markedly more label-efficient than existing pathology foundation models, detecting normal epithelium amid look-alike tumour with an F1 of 0.82 from only a few annotations and leading the strongest baseline by 0.13 in F1. CytoFormer turns paired H&E and spatial transcriptomics into a reusable, label-efficient representation for cell-level analysis of routine histology. Code and model checkpoints are available at https://github.com/zhihuanglab/CytoFormer .
Förderung
- University of Pennsylvania Perelman School of Medicine
- University of Pennsylvania Abramson Family Cancer Research Institute
Zitieren
APA
Yao, J., Li, S., Yu, A., & Huang, Z. (2026). CytoFormer: a molecularly supervised cell foundation model for histopathology cell classification. Precision Pathology, 1(2), 100006. https://doi.org/10.1016/j.prpath.2026.100006
Vancouver
Yao J, Li S, Yu A, Huang Z. CytoFormer: a molecularly supervised cell foundation model for histopathology cell classification. Precision Pathology. 2026;1(2):100006. doi:10.1016/j.prpath.2026.100006
BibTeX
@article{Yao2026,
author = {Yao, Jialu and Li, Songhao and Yu, Alina and Huang, Zhi},
title = {CytoFormer: a molecularly supervised cell foundation model for histopathology cell classification},
journal = {Precision Pathology},
year = {2026},
volume = {1},
number = {2},
pages = {100006},
doi = {10.1016/j.prpath.2026.100006}
}
EUVIMED