EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A novel 3D image registration technique for augmented reality vision in minimally invasive thoracoscopic pulmonary segmentectomy

J J Peek, X Zhang, K Hildebrandt, S A Max, A H Sadeghi, A J J C Bogers, E A F Mahtab

International Journal of Computer Assisted Radiology and Surgery · 20.12.2024 · 20 (4) · 787-795

DOI: 10.1007/s11548-024-03308-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, online erschienen am 20.12.2024. Verfasst von J J Peek und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Cardiothoracic Surgery, Erasmus University Medical Center, Rotterdam, The Netherlands. Hauptthemen laut MEDLINE: Augmented Reality, Imaging, Three-Dimensional, Thoracic Surgery, Video-Assisted, Pneumonectomy. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

In this feasibility study, we aimed to create a dedicated pulmonary augmented reality (AR) workflow to enable a semi-automated intraoperative overlay of the pulmonary anatomy during video-assisted thoracoscopic surgery (VATS) or robot-assisted thoracoscopic surgery (RATS).

Methods

Initially, the stereoscopic cameras were calibrated to obtain the intrinsic camera parameters. Intraoperatively, stereoscopic images were recorded and a 3D point cloud was generated from these images. By manually selecting the bifurcation key points, the 3D segmentation (from the diagnostic CT scan) was registered onto the intraoperative 3D point cloud.

Results

Image reprojection errors were 0.34 and 0.22 pixels for the VATS and RATS cameras, respectively. We created disparity maps and point clouds for all eight patients. Time for creation of the 3D AR overlay was 5 min. Validation of the point clouds was performed, resulting in a median absolute error of 0.20 mm [IQR 0.10–0.54]. We were able to visualize the AR overlay and identify the arterial bifurcations adequately for five patients. In addition to creating AR overlays of the visible or invisible structures intraoperatively, we successfully visualized branch labels and altered the transparency of the overlays.

Conclusion

An algorithm was developed transforming the operative field into a 3D point cloud surface. This allowed for an accurate registration and visualization of preoperative 3D models. Using this system, surgeons can navigate through the patient's anatomy intraoperatively, especially during crucial moments, by visualizing otherwise invisible structures. This proposed registration method lays the groundwork for automated intraoperative AR navigation during minimally invasive pulmonary resections.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Augmented RealityImaging, Three-DimensionalThoracic Surgery, Video-AssistedPneumonectomyRobotic Surgical ProceduresSurgery, Computer-AssistedLung NeoplasmsHumansFeasibility StudiesMaleTomography, X-Ray ComputedFemaleMiddle AgedAged

Stichwörter der Autor:innen

3D point cloudAugmented realityRegistrationRobotic-assisted thoracoscopic surgeryVideo-assisted thoracoscopic surgery

Autor:innen und Institutionen

  • Department of Cardiothoracic Surgery, Erasmus University Medical Center, Rotterdam, The Netherlands.
  • Computer Vision Lab, TU Delft, Delft, The Netherlands.
  • Computer Graphics and Visualization Lab, TU Delft, Delft, The Netherlands.
  • Department of Cardiothoracic Surgery, Leiden University Medical Center, Leiden, The Netherlands.
  • Department of Cardiothoracic Surgery, University Medical Center Utrecht, Utrecht, The Netherlands.
  • Department of Cardiothoracic Surgery, Erasmus University Medical Center, Rotterdam, The Netherlands. e.a.f.mahtab@lumc.nl.

Zitieren

APA

Peek, J. J., Zhang, X., Hildebrandt, K., Max, S. A., Sadeghi, A. H., Bogers, A. J. J. C., & Mahtab, E. A. F. (2024). A novel 3D image registration technique for augmented reality vision in minimally invasive thoracoscopic pulmonary segmentectomy. International Journal of Computer Assisted Radiology and Surgery, 20(4), 787-795. https://doi.org/10.1007/s11548-024-03308-7

Vancouver

Peek JJ, Zhang X, Hildebrandt K, Max SA, Sadeghi AH, Bogers AJJC, et al. A novel 3D image registration technique for augmented reality vision in minimally invasive thoracoscopic pulmonary segmentectomy. International Journal of Computer Assisted Radiology and Surgery. 2024;20(4):787-795. doi:10.1007/s11548-024-03308-7

BibTeX
@article{Peek2024,
  author = {Peek, J J and Zhang, X and Hildebrandt, K and Max, S A and Sadeghi, A H and Bogers, A J J C and Mahtab, E A F},
  title = {A novel 3D image registration technique for augmented reality vision in minimally invasive thoracoscopic pulmonary segmentectomy},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2024},
  volume = {20},
  number = {4},
  pages = {787--795},
  doi = {10.1007/s11548-024-03308-7}
}
Kostenlos starten →