EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Versatile multiple object tracking in sparse 2D/3D videos via deformable image registration

James Ryu, Amin Nejatbakhsh, Mahdi Torkashvand iD, Sahana Gangadharan, Maedeh Seyedolmohadesin, Jinmahn Kim, Liam Paninski, Vivek Venkatachalam iD

PLOS Computational Biology · 20.05.2024 · 20 (5) · e1012075

DOI: 10.1371/journal.pcbi.1012075 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 20.05.2024. Verfasst von James Ryu und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Physics, Northeastern University, Boston, Massachusetts, United States of America. Hauptthemen laut MEDLINE: Computational Biology. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NINDS NIH HHS, Burroughs Wellcome Fund, National Institute of Neurological Disorders and Stroke.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Tracking body parts in behaving animals, extracting fluorescence signals from cells embedded in deforming tissue, and analyzing cell migration patterns during development all require tracking objects with partially correlated motion. As dataset sizes increase, manual tracking of objects becomes prohibitively inefficient and slow, necessitating automated and semi-automated computational tools. Unfortunately, existing methods for multiple object tracking (MOT) are either developed for specific datasets and hence do not generalize well to other datasets, or require large amounts of training data that are not readily available. This is further exacerbated when tracking fluorescent sources in moving and deforming tissues, where the lack of unique features and sparsely populated images create a challenging environment, especially for modern deep learning techniques. By leveraging technology recently developed for spatial transformer networks, we propose ZephIR, an image registration framework for semi-supervised MOT in 2D and 3D videos. ZephIR can generalize to a wide range of biological systems by incorporating adjustable parameters that encode spatial (sparsity, texture, rigidity) and temporal priors of a given data class. We demonstrate the accuracy and versatility of our approach in a variety of applications, including tracking the body parts of a behaving mouse and neurons in the brain of a freely moving C. elegans . We provide an open-source package along with a web-based graphical user interface that allows users to provide small numbers of annotations to interactively improve tracking results.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Computational BiologyAnimalsMiceCaenorhabditis elegansImaging, Three-DimensionalImage Processing, Computer-AssistedAlgorithmsDeep Learning

Autor:innen und Institutionen

  • Department of Physics, Northeastern University, Boston, Massachusetts, United States of America.
  • Department of Neuroscience, Columbia University, New York, New York, United States of America.

ORCID-Profile: Mahdi Torkashvand, Vivek Venkatachalam

Förderung

  • NINDS NIH HHS
  • Burroughs Wellcome Fund
  • National Institute of Neurological Disorders and Stroke

Zitieren

APA

Ryu, J., Nejatbakhsh, A., Torkashvand, M., Gangadharan, S., Seyedolmohadesin, M., Kim, J., Paninski, L., & Venkatachalam, V. (2024). Versatile multiple object tracking in sparse 2D/3D videos via deformable image registration. PLOS Computational Biology, 20(5), e1012075. https://doi.org/10.1371/journal.pcbi.1012075

Vancouver

Ryu J, Nejatbakhsh A, Torkashvand M, Gangadharan S, Seyedolmohadesin M, Kim J, et al. Versatile multiple object tracking in sparse 2D/3D videos via deformable image registration. PLOS Computational Biology. 2024;20(5):e1012075. doi:10.1371/journal.pcbi.1012075

BibTeX
@article{Ryu2024,
  author = {Ryu, James and Nejatbakhsh, Amin and Torkashvand, Mahdi and Gangadharan, Sahana and Seyedolmohadesin, Maedeh and Kim, Jinmahn and Paninski, Liam and Venkatachalam, Vivek},
  title = {Versatile multiple object tracking in sparse 2D/3D videos via deformable image registration},
  journal = {PLOS Computational Biology},
  year = {2024},
  volume = {20},
  number = {5},
  pages = {e1012075},
  doi = {10.1371/journal.pcbi.1012075}
}
Kostenlos starten →