Computer Vision and Machine-Learning Techniques for Automatic 3D Virtual Images Overlapping During Augmented Reality Guided Robotic Partial Nephrectomy
Technology in Cancer Research & Treatment · 2024-01 · 23
DOI: 10.1177/15330338241229368 ↗Kurz gefasst
Fachartikel in der Zeitschrift Technology in Cancer Research & Treatment, online erschienen am 19.02.2024. Verfasst von Daniele Amparore und 14 weiteren Autor:innen. Beteiligte Einrichtung: Division of Urology, Dept. of Oncology, School of Medicine, University of Turin, San Luigi Hospital, Orbassano (Turin), Italy. Hauptthemen laut MEDLINE: Robotic Surgical Procedures, Augmented Reality, Surgery, Computer-Assisted, Kidney Neoplasms. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Objectives
The research's purpose is to develop a software that automatically integrates and overlay 3D virtual models of kidneys harboring renal masses into the Da Vinci robotic console, assisting surgeon during the intervention.
Introduction
Precision medicine, especially in the field of minimally-invasive partial nephrectomy, aims to use 3D virtual models as a guidance for augmented reality robotic procedures. However, the co-registration process of the virtual images over the real operative field is performed manually.
Methods
In this prospective study, two strategies for the automatic overlapping of the model over the real kidney were explored: the computer vision technology, leveraging the super-enhancement of the kidney allowed by the intraoperative injection of Indocyanine green for superimposition and the convolutional neural network technology, based on the processing of live images from the endoscope, after a training of the software on frames from prerecorded videos of the same surgery. The work-team, comprising a bioengineer, a software-developer and a surgeon, collaborated to create hyper-accuracy 3D models for automatic 3D-AR-guided RAPN. For each patient, demographic and clinical data were collected.
Results
Two groups (group A for the first technology with 12 patients and group B for the second technology with 8 patients) were defined. They showed comparable preoperative and post-operative characteristics. Concerning the first technology the average co-registration time was 7 (3–11) seconds while in the case of the second technology 11 (6–13) seconds. No major intraoperative or postoperative complications were recorded. There were no differences in terms of functional outcomes between the groups at every time-point considered.
Conclusion
The first technology allowed a successful anchoring of the 3D model to the kidney, despite minimal manual refinements. The second technology improved kidney automatic detection without relying on indocyanine injection, resulting in better organ boundaries identification during tests. Further studies are needed to confirm this preliminary evidence.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Urology, Dept. of Oncology, School of Medicine, University of Turin, San Luigi Hospital, Orbassano (Turin), Italy.
- Department of Surgery, Candiolo Cancer Institute FPO-IRCCS, Candiolo, Italy.
- Department of Urology, Romolo Hospital, Rocca di Neto (KR), Italy.
- Urology Unit, University Hospital of Parma, Parma, Italy.
- 2nd Level Master Degree Program in Advanced Robotic and Laparoscopic Surgery in Urology, Division of Urology, Dept. of Oncology, School of Medicine, University of Turin, San Luigi, Italy.
- Division of Urology, Department of Surgery, Annunziata Hospital, Cosenza, Italy.
ORCID-Profile: Davide Campobasso
Zitieren
APA
Amparore, D., Sica, M., Verri, P., Piramide, F., Checcucci, E., De Cillis, S., Piana, A., Campobasso, D., Burgio, M., Cisero, E., Busacca, G., Di Dio, M., Piazzolla, P., Fiori, C., & Porpiglia, F. (2024). Computer Vision and Machine-Learning Techniques for Automatic 3D Virtual Images Overlapping During Augmented Reality Guided Robotic Partial Nephrectomy. Technology in Cancer Research & Treatment, 23. https://doi.org/10.1177/15330338241229368
Vancouver
Amparore D, Sica M, Verri P, Piramide F, Checcucci E, De Cillis S, et al. Computer Vision and Machine-Learning Techniques for Automatic 3D Virtual Images Overlapping During Augmented Reality Guided Robotic Partial Nephrectomy. Technology in Cancer Research & Treatment. 2024;23. doi:10.1177/15330338241229368
BibTeX
@article{Amparore2024,
author = {Amparore, Daniele and Sica, Michele and Verri, Paolo and Piramide, Federico and Checcucci, Enrico and De Cillis, Sabrina and Piana, Alberto and Campobasso, Davide and Burgio, Mariano and Cisero, Edoardo and Busacca, Giovanni and Di Dio, Michele and Piazzolla, Pietro and Fiori, Cristian and Porpiglia, Francesco},
title = {Computer Vision and Machine-Learning Techniques for Automatic 3D Virtual Images Overlapping During Augmented Reality Guided Robotic Partial Nephrectomy},
journal = {Technology in Cancer Research & Treatment},
year = {2024},
volume = {23},
doi = {10.1177/15330338241229368}
}
EUVIMED