Versatile multiple object tracking in sparse 2D/3D videos via deformable image registration
PLOS Computational Biology · 20.05.2024 · 20 (5) · e1012075
DOI: 10.1371/journal.pcbi.1012075 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 20.05.2024. Verfasst von James Ryu und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Physics, Northeastern University, Boston, Massachusetts, United States of America. Hauptthemen laut MEDLINE: Computational Biology. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NINDS NIH HHS, Burroughs Wellcome Fund, National Institute of Neurological Disorders and Stroke.
Abstract (Originalsprache)
Tracking body parts in behaving animals, extracting fluorescence signals from cells embedded in deforming tissue, and analyzing cell migration patterns during development all require tracking objects with partially correlated motion. As dataset sizes increase, manual tracking of objects becomes prohibitively inefficient and slow, necessitating automated and semi-automated computational tools. Unfortunately, existing methods for multiple object tracking (MOT) are either developed for specific datasets and hence do not generalize well to other datasets, or require large amounts of training data that are not readily available. This is further exacerbated when tracking fluorescent sources in moving and deforming tissues, where the lack of unique features and sparsely populated images create a challenging environment, especially for modern deep learning techniques. By leveraging technology recently developed for spatial transformer networks, we propose ZephIR, an image registration framework for semi-supervised MOT in 2D and 3D videos. ZephIR can generalize to a wide range of biological systems by incorporating adjustable parameters that encode spatial (sparsity, texture, rigidity) and temporal priors of a given data class. We demonstrate the accuracy and versatility of our approach in a variety of applications, including tracking the body parts of a behaving mouse and neurons in the brain of a freely moving C. elegans . We provide an open-source package along with a web-based graphical user interface that allows users to provide small numbers of annotations to interactively improve tracking results.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Physics, Northeastern University, Boston, Massachusetts, United States of America.
- Department of Neuroscience, Columbia University, New York, New York, United States of America.
ORCID-Profile: Mahdi Torkashvand, Vivek Venkatachalam
Förderung
- NINDS NIH HHS
- Burroughs Wellcome Fund
- National Institute of Neurological Disorders and Stroke
Zitieren
APA
Ryu, J., Nejatbakhsh, A., Torkashvand, M., Gangadharan, S., Seyedolmohadesin, M., Kim, J., Paninski, L., & Venkatachalam, V. (2024). Versatile multiple object tracking in sparse 2D/3D videos via deformable image registration. PLOS Computational Biology, 20(5), e1012075. https://doi.org/10.1371/journal.pcbi.1012075
Vancouver
Ryu J, Nejatbakhsh A, Torkashvand M, Gangadharan S, Seyedolmohadesin M, Kim J, et al. Versatile multiple object tracking in sparse 2D/3D videos via deformable image registration. PLOS Computational Biology. 2024;20(5):e1012075. doi:10.1371/journal.pcbi.1012075
BibTeX
@article{Ryu2024,
author = {Ryu, James and Nejatbakhsh, Amin and Torkashvand, Mahdi and Gangadharan, Sahana and Seyedolmohadesin, Maedeh and Kim, Jinmahn and Paninski, Liam and Venkatachalam, Vivek},
title = {Versatile multiple object tracking in sparse 2D/3D videos via deformable image registration},
journal = {PLOS Computational Biology},
year = {2024},
volume = {20},
number = {5},
pages = {e1012075},
doi = {10.1371/journal.pcbi.1012075}
}
EUVIMED