Efficient EndoNeRF reconstruction and its application for data-driven surgical simulation
International Journal of Computer Assisted Radiology and Surgery · 24.04.2024 · 19 (5) · 821-829
DOI: 10.1007/s11548-024-03114-1 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, online erschienen am 24.04.2024. Verfasst von Yuehao Wang und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China. Hauptthemen laut MEDLINE: Imaging, Three-Dimensional, Computer Simulation. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Multi-Scale Medical Robotics Centre InnoHK, Research Grants Council of the Hong Kong Special Administrative Region, China, Shenzhen-Hong Kong Collaborative Development Zone.
Abstract (Originalsprache)
Purpose
The healthcare industry has a growing need for realistic modeling and efficient simulation of surgical scenes. With effective models of deformable surgical scenes, clinicians are able to conduct surgical planning and surgery training on scenarios close to real-world cases. However, a significant challenge in achieving such a goal is the scarcity of high-quality soft tissue models with accurate shapes and textures. To address this gap, we present a data-driven framework that leverages emerging neural radiance field technology to enable high-quality surgical reconstruction and explore its application for surgical simulations.
Method
We first focus on developing a fast NeRF-based surgical scene 3D reconstruction approach that achieves state-of-the-art performance. This method can significantly outperform traditional 3D reconstruction methods, which have failed to capture large deformations and produce fine-grained shapes and textures. We then propose an automated creation pipeline of interactive surgical simulation environments through a closed mesh extraction algorithm.
Results
Our experiments have validated the superior performance and efficiency of our proposed approach in surgical scene 3D reconstruction. We further utilize our reconstructed soft tissues to conduct FEM and MPM simulations, showcasing the practical application of our method in data-driven surgical simulations.
Conclusion
We have proposed a novel NeRF-based reconstruction framework with an emphasis on simulation purposes. Our reconstruction framework facilitates the efficient creation of high-quality surgical soft tissue 3D models. With multiple soft tissue simulations demonstrated, we show that our work has the potential to benefit downstream clinical tasks, such as surgical education.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China.
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong, China.
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China. qidou@cuhk.edu.hk.
Förderung
- Multi-Scale Medical Robotics Centre InnoHK
- Research Grants Council of the Hong Kong Special Administrative Region, China
- Shenzhen-Hong Kong Collaborative Development Zone
Zitieren
APA
Wang, Y., Gong, B., Long, Y., Fan, S. H., & Dou, Q. (2024). Efficient EndoNeRF reconstruction and its application for data-driven surgical simulation. International Journal of Computer Assisted Radiology and Surgery, 19(5), 821-829. https://doi.org/10.1007/s11548-024-03114-1
Vancouver
Wang Y, Gong B, Long Y, Fan SH, Dou Q. Efficient EndoNeRF reconstruction and its application for data-driven surgical simulation. International Journal of Computer Assisted Radiology and Surgery. 2024;19(5):821-829. doi:10.1007/s11548-024-03114-1
BibTeX
@article{Wang2024,
author = {Wang, Yuehao and Gong, Bingchen and Long, Yonghao and Fan, Siu Hin and Dou, Qi},
title = {Efficient EndoNeRF reconstruction and its application for data-driven surgical simulation},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2024},
volume = {19},
number = {5},
pages = {821--829},
doi = {10.1007/s11548-024-03114-1}
}
EUVIMED