In Vivo Demonstration of Deep Learning-Based Photoacoustic Visual Servoing System
IEEE Transactions on Biomedical Engineering · 2026-01 · 73 (1) · 417-431
DOI: 10.1109/tbme.2025.3584076 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Biomedical Engineering, 2026-01. Verfasst von Mardava R Gubbi und 8 weiteren Autor:innen. Hauptthemen laut MEDLINE: Deep Learning, Photoacoustic Techniques. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NIBIB NIH HHS, NSF, National Institutes of Health Trailblazer.
Abstract (Originalsprache)
OBJECTIVE: To develop the first known deep learning-based photoacoustic visual servoing system utilizing point source localization and hybrid position-force control to track catheter tips in three dimensions in real-time. METHODS: We integrated either object detection or instance segmentation-based localization with hybrid position-force control to create our novel system. Cardiac catheter tips were then tracked across distances of 40 mm in a plastisol phantom and 25-64 mm in an in vivo swine in real-time in nine visual servoing trials total. RESULTS: Object detection-based localization identified the cardiac catheter tip in 88.0-91.7% and 66.7-70.4% of phantom and in vivo channel data frames, respectively. Instance segmentation detection rates ranged 86.4-100.0% in vivo. These catheter tips were tracked with errors as low as 0.5 mm in phantom trials and 0.8 mm in the in vivo trials. The mean inference times were $\geq$ 145.3 ms and $\geq$ 516.3 ms with object detection-based and instance segmentation-based point source localization, respectively. The hybrid position-force control system enabled contact with the imaging surface during $\geq$99.43% of each visual servoing trial. CONCLUSION: Our novel deep learning-based photoacoustic visual servoing system was successfully demonstrated. Object detection-based localization operated with inference times that are more suitable for real-time implementations while instance segmentation had lower tracking errors. SIGNIFICANCE: After implementing suggested optimization modifications, our novel system has the potential to track catheter tips, needle tips, and other surgical tool tips in real-time during surgical and interventional procedures.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- NIBIB NIH HHS
- NSF
- National Institutes of Health Trailblazer
- National Science Foundation (NSF) CAREER
- NSF Smart Health and Biomedical Research in the Era of Artificial Intelligence and Advanced Data Science
Zitieren
APA
Gubbi, M. R., Kolandaivelu, A., Venkatayogi, N., Zhang, J., Warbal, P., Keene, G. C., Khairalseed, M., Chrispin, J., & Bell, M. A. L. (2026). In Vivo Demonstration of Deep Learning-Based Photoacoustic Visual Servoing System. IEEE Transactions on Biomedical Engineering, 73(1), 417-431. https://doi.org/10.1109/tbme.2025.3584076
Vancouver
Gubbi MR, Kolandaivelu A, Venkatayogi N, Zhang J, Warbal P, Keene GC, et al. In Vivo Demonstration of Deep Learning-Based Photoacoustic Visual Servoing System. IEEE Transactions on Biomedical Engineering. 2026;73(1):417-431. doi:10.1109/tbme.2025.3584076
BibTeX
@article{Gubbi2026,
author = {Gubbi, Mardava R and Kolandaivelu, Aravindan and Venkatayogi, Nethra and Zhang, Jiaxin and Warbal, Pankaj and Keene, Gareth C and Khairalseed, Mawia and Chrispin, Jonathan and Bell, Muyinatu A Lediju},
title = {In Vivo Demonstration of Deep Learning-Based Photoacoustic Visual Servoing System},
journal = {IEEE Transactions on Biomedical Engineering},
year = {2026},
volume = {73},
number = {1},
pages = {417--431},
doi = {10.1109/tbme.2025.3584076}
}
EUVIMED