EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Endoscope Automation Framework with Hierarchical Control and Interactive Perception for Multi-Tool Tracking in Minimally Invasive Surgery

Khusniddin Fozilov iD, Jacinto Colan iD, Ana Davila iD, Kazunari Misawa, Jie Qiu, Yuichiro Hayashi, Kensaku Mori, Yasuhisa Hasegawa iD

Sensors · 16.12.2023 · 23 (24) · 9865

DOI: 10.3390/s23249865 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 16.12.2023. Verfasst von Khusniddin Fozilov und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Micro-Nano Mechanical Science and Engineering, Nagoya University, Furo-cho, Chikusa-ku, Nagoya 464-8603, Aichi, Japan. Hauptthemen laut MEDLINE: Endoscopes, Minimally Invasive Surgical Procedures. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency, Japan Science and Technology Agency (JST) CREST.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the context of Minimally Invasive Surgery, surgeons mainly rely on visual feedback during medical operations. In common procedures such as tissue resection, the automation of endoscopic control is crucial yet challenging, particularly due to the interactive dynamics of multi-agent operations and the necessity for real-time adaptation. This paper introduces a novel framework that unites a Hierarchical Quadratic Programming controller with an advanced interactive perception module. This integration addresses the need for adaptive visual field control and robust tool tracking in the operating scene, ensuring that surgeons and assistants have optimal viewpoint throughout the surgical task. The proposed framework handles multiple objectives within predefined thresholds, ensuring efficient tracking even amidst changes in operating backgrounds, varying lighting conditions, and partial occlusions. Empirical validations in scenarios involving single, double, and quadruple tool tracking during tissue resection tasks have underscored the system’s robustness and adaptability. The positive feedback from user studies, coupled with the low cognitive and physical strain reported by surgeons and assistants, highlight the system’s potential for real-world application.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EndoscopesMinimally Invasive Surgical ProceduresEndoscopyAutomationPerception

Stichwörter der Autor:innen

Hierarchical Quadratic Programmingautonomous systemsrobotic surgerysegmentation and trackingvisual servoing

Autor:innen und Institutionen

  • Department of Micro-Nano Mechanical Science and Engineering, Nagoya University, Furo-cho, Chikusa-ku, Nagoya 464-8603, Aichi, Japan.
  • Institutes of Innovation for Future Society, Nagoya University, Furo-cho, Chikusa-ku, Nagoya 464-8603, Aichi, Japan.
  • Aichi Cancer Center Hospital, Chikusa Ward, Nagoya 464-8681, Aichi, Japan.
  • Graduate School of Informatics, Nagoya University, Chikusa Ward, Nagoya 464-8601, Aichi, Japan.

ORCID-Profile: Khusniddin Fozilov, Jacinto Colan, Ana Davila, Yasuhisa Hasegawa

Förderung

  • Japan Science and Technology Agency
  • Japan Science and Technology Agency (JST) CREST

Zitieren

APA

Fozilov, K., Colan, J., Davila, A., Misawa, K., Qiu, J., Hayashi, Y., Mori, K., & Hasegawa, Y. (2023). Endoscope Automation Framework with Hierarchical Control and Interactive Perception for Multi-Tool Tracking in Minimally Invasive Surgery. Sensors, 23(24), 9865. https://doi.org/10.3390/s23249865

Vancouver

Fozilov K, Colan J, Davila A, Misawa K, Qiu J, Hayashi Y, et al. Endoscope Automation Framework with Hierarchical Control and Interactive Perception for Multi-Tool Tracking in Minimally Invasive Surgery. Sensors. 2023;23(24):9865. doi:10.3390/s23249865

BibTeX
@article{Fozilov2023,
  author = {Fozilov, Khusniddin and Colan, Jacinto and Davila, Ana and Misawa, Kazunari and Qiu, Jie and Hayashi, Yuichiro and Mori, Kensaku and Hasegawa, Yasuhisa},
  title = {Endoscope Automation Framework with Hierarchical Control and Interactive Perception for Multi-Tool Tracking in Minimally Invasive Surgery},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {24},
  pages = {9865},
  doi = {10.3390/s23249865}
}
Kostenlos starten →