Endoscope Automation Framework with Hierarchical Control and Interactive Perception for Multi-Tool Tracking in Minimally Invasive Surgery
Sensors · 16.12.2023 · 23 (24) · 9865
DOI: 10.3390/s23249865 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 16.12.2023. Verfasst von Khusniddin Fozilov und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Micro-Nano Mechanical Science and Engineering, Nagoya University, Furo-cho, Chikusa-ku, Nagoya 464-8603, Aichi, Japan. Hauptthemen laut MEDLINE: Endoscopes, Minimally Invasive Surgical Procedures. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency, Japan Science and Technology Agency (JST) CREST.
Abstract (Originalsprache)
In the context of Minimally Invasive Surgery, surgeons mainly rely on visual feedback during medical operations. In common procedures such as tissue resection, the automation of endoscopic control is crucial yet challenging, particularly due to the interactive dynamics of multi-agent operations and the necessity for real-time adaptation. This paper introduces a novel framework that unites a Hierarchical Quadratic Programming controller with an advanced interactive perception module. This integration addresses the need for adaptive visual field control and robust tool tracking in the operating scene, ensuring that surgeons and assistants have optimal viewpoint throughout the surgical task. The proposed framework handles multiple objectives within predefined thresholds, ensuring efficient tracking even amidst changes in operating backgrounds, varying lighting conditions, and partial occlusions. Empirical validations in scenarios involving single, double, and quadruple tool tracking during tissue resection tasks have underscored the system’s robustness and adaptability. The positive feedback from user studies, coupled with the low cognitive and physical strain reported by surgeons and assistants, highlight the system’s potential for real-world application.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Micro-Nano Mechanical Science and Engineering, Nagoya University, Furo-cho, Chikusa-ku, Nagoya 464-8603, Aichi, Japan.
- Institutes of Innovation for Future Society, Nagoya University, Furo-cho, Chikusa-ku, Nagoya 464-8603, Aichi, Japan.
- Aichi Cancer Center Hospital, Chikusa Ward, Nagoya 464-8681, Aichi, Japan.
- Graduate School of Informatics, Nagoya University, Chikusa Ward, Nagoya 464-8601, Aichi, Japan.
ORCID-Profile: Khusniddin Fozilov, Jacinto Colan, Ana Davila, Yasuhisa Hasegawa
Förderung
- Japan Science and Technology Agency
- Japan Science and Technology Agency (JST) CREST
Zitieren
APA
Fozilov, K., Colan, J., Davila, A., Misawa, K., Qiu, J., Hayashi, Y., Mori, K., & Hasegawa, Y. (2023). Endoscope Automation Framework with Hierarchical Control and Interactive Perception for Multi-Tool Tracking in Minimally Invasive Surgery. Sensors, 23(24), 9865. https://doi.org/10.3390/s23249865
Vancouver
Fozilov K, Colan J, Davila A, Misawa K, Qiu J, Hayashi Y, et al. Endoscope Automation Framework with Hierarchical Control and Interactive Perception for Multi-Tool Tracking in Minimally Invasive Surgery. Sensors. 2023;23(24):9865. doi:10.3390/s23249865
BibTeX
@article{Fozilov2023,
author = {Fozilov, Khusniddin and Colan, Jacinto and Davila, Ana and Misawa, Kazunari and Qiu, Jie and Hayashi, Yuichiro and Mori, Kensaku and Hasegawa, Yasuhisa},
title = {Endoscope Automation Framework with Hierarchical Control and Interactive Perception for Multi-Tool Tracking in Minimally Invasive Surgery},
journal = {Sensors},
year = {2023},
volume = {23},
number = {24},
pages = {9865},
doi = {10.3390/s23249865}
}
EUVIMED