Cell-TRACTR: A transformer-based model for end-to-end segmentation and tracking of cells
PLOS Computational Biology · 2025
DOI: 10.1371/journal.pcbi.1013071 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, 2025. Verfasst von Owen M O'Connor und 1 weiteren Autor:innen. Beteiligte Einrichtung: Biomedical Engineering, Boston University, Boston, Massachusetts, United States of America. Hauptthemen laut MEDLINE: Cell Tracking, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 81 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.
Abstract (Originalsprache)
Deep learning-based methods for identifying and tracking cells within microscopy images have revolutionized the speed and throughput of data analysis. These methods for analyzing biological and medical data have capitalized on advances from the broader computer vision field. However, cell tracking can present unique challenges, with frequent cell division events and the need to track many objects with similar visual appearances complicating analysis. Existing architectures developed for cell tracking based on convolutional neural networks (CNNs) have tended to fall short in managing the spatial and global contextual dependencies that are crucial for tracking cells. To overcome these limitations, we introduce Cell-TRACTR ( Tr ansformer with A ttention for C ell T racking and R ecognition), a novel deep learning model that uses a transformer-based architecture. Cell-TRACTR operates in an end-to-end manner, simultaneously segmenting and tracking cells without the need for post-processing. Alongside this model, we introduce the Cell-HOTA metric, an extension of the Higher Order Tracking Accuracy (HOTA) metric that we adapted to assess cell division. Cell-HOTA differs from standard cell tracking metrics by offering a balanced and easily interpretable assessment of detection, association, and division accuracy. We test our Cell-TRACTR model on datasets of bacteria growing within a defined microfluidic geometry and mammalian cells growing freely in two dimensions. Our results demonstrate that Cell-TRACTR exhibits strong performance in tracking and division accuracy compared to state-of-the-art algorithms, while also meeting traditional benchmarks in detection accuracy. This work establishes a new framework for employing transformer-based models in cell segmentation and tracking.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Biomedical Engineering, Boston University, Boston, Massachusetts, United States of America.
- Biological Design Center, Boston University, Boston, Massachusetts, United States of America.
ORCID-Profile: Owen M O'Connor, Mary J Dunlop
Förderung
- National Science Foundation
Zitieren
APA
O'Connor, O. M., & Dunlop, M. J. (2025). Cell-TRACTR: A transformer-based model for end-to-end segmentation and tracking of cells. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1013071
Vancouver
O'Connor OM, Dunlop MJ. Cell-TRACTR: A transformer-based model for end-to-end segmentation and tracking of cells. PLOS Computational Biology. 2025. doi:10.1371/journal.pcbi.1013071
BibTeX
@article{OConnor2025,
author = {O'Connor, Owen M and Dunlop, Mary J},
title = {Cell-TRACTR: A transformer-based model for end-to-end segmentation and tracking of cells},
journal = {PLOS Computational Biology},
year = {2025},
doi = {10.1371/journal.pcbi.1013071}
}
EUVIMED