OneSLAM to map them all: a generalized approach to SLAM for monocular endoscopic imaging based on tracking any point
International Journal of Computer Assisted Radiology and Surgery · 2024
DOI: 10.1007/s11548-024-03171-6 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2024. Verfasst von Timo Teufel und 9 weiteren Autor:innen. Beteiligte Einrichtung: Johns Hopkins University, Baltimore, MD, 21211, USA. tteufel1@jh.edu. Hauptthemen laut MEDLINE: Algorithms, Endoscopy. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 36 Literaturangaben. Gefördert von: NIH HHS.
Abstract (Originalsprache)
PURPOSE: Monocular SLAM algorithms are the key enabling technology for image-based surgical navigation systems for endoscopic procedures. Due to the visual feature scarcity and unique lighting conditions encountered in endoscopy, classical SLAM approaches perform inconsistently. Many of the recent approaches to endoscopic SLAM rely on deep learning models. They show promising results when optimized on singular domains such as arthroscopy, sinus endoscopy, colonoscopy or laparoscopy, but are limited by an inability to generalize to different domains without retraining. METHODS: To address this generality issue, we propose OneSLAM a monocular SLAM algorithm for surgical endoscopy that works out of the box for several endoscopic domains, including sinus endoscopy, colonoscopy, arthroscopy and laparoscopy. Our pipeline builds upon robust tracking any point (TAP) foundation models to reliably track sparse correspondences across multiple frames and runs local bundle adjustment to jointly optimize camera poses and a sparse 3D reconstruction of the anatomy. RESULTS: We compare the performance of our method against three strong baselines previously proposed for monocular SLAM in endoscopy and general scenes. OneSLAM presents better or comparable performance over existing approaches targeted to that specific data in all four tested domains, generalizing across domains without the need for retraining. CONCLUSION: OneSLAM benefits from the convincing performance of TAP foundation models but generalizes to endoscopic sequences of different anatomies all while demonstrating better or comparable performance over domain-specific SLAM approaches. Future research on global loop closure will investigate how to reliably detect loops in endoscopic scenes to reduce accumulated drift and enhance long-term navigation capabilities.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Johns Hopkins University, Baltimore, MD, 21211, USA. tteufel1@jh.edu.
- Johns Hopkins University, Baltimore, MD, 21211, USA.
- Johns Hopkins Medical Institutions, Baltimore, MD, 21287, USA.
Förderung
- NIH HHS
Zitieren
APA
Teufel, T., Shu, H., Soberanis-Mukul, R. D., Mangulabnan, J. E., Sahu, M., Vedula, S. S., Ishii, M., Hager, G., Taylor, R. H., & Unberath, M. (2024). OneSLAM to map them all: a generalized approach to SLAM for monocular endoscopic imaging based on tracking any point. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-024-03171-6
Vancouver
Teufel T, Shu H, Soberanis-Mukul RD, Mangulabnan JE, Sahu M, Vedula SS, et al. OneSLAM to map them all: a generalized approach to SLAM for monocular endoscopic imaging based on tracking any point. International Journal of Computer Assisted Radiology and Surgery. 2024. doi:10.1007/s11548-024-03171-6
BibTeX
@article{Teufel2024,
author = {Teufel, Timo and Shu, Hongchao and Soberanis-Mukul, Roger D and Mangulabnan, Jan Emily and Sahu, Manish and Vedula, S Swaroop and Ishii, Masaru and Hager, Gregory and Taylor, Russell H and Unberath, Mathias},
title = {OneSLAM to map them all: a generalized approach to SLAM for monocular endoscopic imaging based on tracking any point},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2024},
doi = {10.1007/s11548-024-03171-6}
}
EUVIMED