EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

First‐in‐human real‐time AI‐assisted instrument deocclusion during augmented reality robotic surgery

Jasper Hofman iD, Pieter De Backer, Ilaria Manghi, Jente Simoens, Ruben De Groote, Hannes Van Den Bossche, Mathieu D'Hondt, Tim Oosterlinck, Julie Lippens, Charles Van Praet, Federica Ferraguti, Charlotte Debbaut und 4 weitere

Healthcare Technology Letters · 2024-04 · 11 (2-3) · 33-39

DOI: 10.1049/htl2.12056 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Healthcare Technology Letters, online erschienen am 02.12.2023. Verfasst von Jasper Hofman und 15 weiteren Autor:innen. Beteiligte Einrichtung: ORSI Academy Melle Belgium. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 15 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Universiteit Gent, Agentschap Innoveren en Ondernemen.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The integration of Augmented Reality (AR) into daily surgical practice is withheld by the correct registration of pre‐operative data. This includes intelligent 3D model superposition whilst simultaneously handling real and virtual occlusions caused by the AR overlay. Occlusions can negatively impact surgical safety and as such deteriorate rather than improve surgical care. Robotic surgery is particularly suited to tackle these integration challenges in a stepwise approach as the robotic console allows for different inputs to be displayed in parallel to the surgeon. Nevertheless, real‐time de‐occlusion requires extensive computational resources which further complicates clinical integration. This work tackles the problem of instrument occlusion and presents, to the authors’ best knowledge, the first‐in‐human on edge deployment of a real‐time binary segmentation pipeline during three robot‐assisted surgeries: partial nephrectomy, migrated endovascular stent removal, and liver metastasectomy. To this end, a state‐of‐the‐art real‐time segmentation and 3D model pipeline was implemented and presented to the surgeon during live surgery. The pipeline allows real‐time binary segmentation of 37 non‐organic surgical items, which are never occluded during AR. The application features real‐time manual 3D model manipulation for correct soft tissue alignment. The proposed pipeline can contribute towards surgical safety, ergonomics, and acceptance of AR in minimally invasive surgery.

Schlagwörter

Stichwörter der Autor:innen

augmented realitycomputer visionimage processingimage segmentationlearning (artificial intelligence)medical roboticsreal‐time systemssurgery

Autor:innen und Institutionen

  • ORSI Academy Melle Belgium.
  • Faculty of Medicine and Health Sciences, Department of Human Structure and Repair Ghent University Ghent Belgium.
  • IBiTech-Biommeda, Faculty of Engineering and Architecture, and CRIG Ghent University Ghent Belgium.
  • Department of Urology Ghent University Hospital Ghent Belgium.
  • Department of Sciences and Methods for Engineering University of Modena and Reggio Emilia Modena Italy.
  • Department of Urology OLV Hospital Aalst Belgium.

ORCID-Profile: Jasper Hofman

Förderung

  • Universiteit Gent
  • Agentschap Innoveren en Ondernemen

Zitieren

APA

Hofman, J., De Backer, P., Manghi, I., Simoens, J., De Groote, R., Van Den Bossche, H., D'Hondt, M., Oosterlinck, T., Lippens, J., Van Praet, C., Ferraguti, F., Debbaut, C., Li, Z., Kutter, O., Mottrie, A., & Decaestecker, K. (2024). First‐in‐human real‐time AI‐assisted instrument deocclusion during augmented reality robotic surgery. Healthcare Technology Letters, 11(2-3), 33-39. https://doi.org/10.1049/htl2.12056

Vancouver

Hofman J, De Backer P, Manghi I, Simoens J, De Groote R, Van Den Bossche H, et al. First‐in‐human real‐time AI‐assisted instrument deocclusion during augmented reality robotic surgery. Healthcare Technology Letters. 2024;11(2-3):33-39. doi:10.1049/htl2.12056

BibTeX
@article{Hofman2024,
  author = {Hofman, Jasper and De Backer, Pieter and Manghi, Ilaria and Simoens, Jente and De Groote, Ruben and Van Den Bossche, Hannes and D'Hondt, Mathieu and Oosterlinck, Tim and Lippens, Julie and Van Praet, Charles and Ferraguti, Federica and Debbaut, Charlotte and Li, Zhijin and Kutter, Oliver and Mottrie, Alexandre and Decaestecker, Karel},
  title = {First‐in‐human real‐time AI‐assisted instrument deocclusion during augmented reality robotic surgery},
  journal = {Healthcare Technology Letters},
  year = {2024},
  volume = {11},
  number = {2-3},
  pages = {33--39},
  doi = {10.1049/htl2.12056}
}
Kostenlos starten →