EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Efficient EndoNeRF reconstruction and its application for data-driven surgical simulation

Yuehao Wang, Bingchen Gong, Yonghao Long, Siu Hin Fan, Qi Dou

International Journal of Computer Assisted Radiology and Surgery · 24.04.2024 · 19 (5) · 821-829

DOI: 10.1007/s11548-024-03114-1 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, online erschienen am 24.04.2024. Verfasst von Yuehao Wang und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China. Hauptthemen laut MEDLINE: Imaging, Three-Dimensional, Computer Simulation. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Multi-Scale Medical Robotics Centre InnoHK, Research Grants Council of the Hong Kong Special Administrative Region, China, Shenzhen-Hong Kong Collaborative Development Zone.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

The healthcare industry has a growing need for realistic modeling and efficient simulation of surgical scenes. With effective models of deformable surgical scenes, clinicians are able to conduct surgical planning and surgery training on scenarios close to real-world cases. However, a significant challenge in achieving such a goal is the scarcity of high-quality soft tissue models with accurate shapes and textures. To address this gap, we present a data-driven framework that leverages emerging neural radiance field technology to enable high-quality surgical reconstruction and explore its application for surgical simulations.

Method

We first focus on developing a fast NeRF-based surgical scene 3D reconstruction approach that achieves state-of-the-art performance. This method can significantly outperform traditional 3D reconstruction methods, which have failed to capture large deformations and produce fine-grained shapes and textures. We then propose an automated creation pipeline of interactive surgical simulation environments through a closed mesh extraction algorithm.

Results

Our experiments have validated the superior performance and efficiency of our proposed approach in surgical scene 3D reconstruction. We further utilize our reconstructed soft tissues to conduct FEM and MPM simulations, showcasing the practical application of our method in data-driven surgical simulations.

Conclusion

We have proposed a novel NeRF-based reconstruction framework with an emphasis on simulation purposes. Our reconstruction framework facilitates the efficient creation of high-quality surgical soft tissue 3D models. With multiple soft tissue simulations demonstrated, we show that our work has the potential to benefit downstream clinical tasks, such as surgical education.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Imaging, Three-DimensionalComputer SimulationHumansAlgorithmsSurgery, Computer-Assisted

Stichwörter der Autor:innen

3D reconstructionNeRFRobotic surgerySurgery simulation

Autor:innen und Institutionen

  • Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China.
  • Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong, China.
  • Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China. qidou@cuhk.edu.hk.

Förderung

  • Multi-Scale Medical Robotics Centre InnoHK
  • Research Grants Council of the Hong Kong Special Administrative Region, China
  • Shenzhen-Hong Kong Collaborative Development Zone

Zitieren

APA

Wang, Y., Gong, B., Long, Y., Fan, S. H., & Dou, Q. (2024). Efficient EndoNeRF reconstruction and its application for data-driven surgical simulation. International Journal of Computer Assisted Radiology and Surgery, 19(5), 821-829. https://doi.org/10.1007/s11548-024-03114-1

Vancouver

Wang Y, Gong B, Long Y, Fan SH, Dou Q. Efficient EndoNeRF reconstruction and its application for data-driven surgical simulation. International Journal of Computer Assisted Radiology and Surgery. 2024;19(5):821-829. doi:10.1007/s11548-024-03114-1

BibTeX
@article{Wang2024,
  author = {Wang, Yuehao and Gong, Bingchen and Long, Yonghao and Fan, Siu Hin and Dou, Qi},
  title = {Efficient EndoNeRF reconstruction and its application for data-driven surgical simulation},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2024},
  volume = {19},
  number = {5},
  pages = {821--829},
  doi = {10.1007/s11548-024-03114-1}
}
Kostenlos starten →