MIS-NeRF: neural radiance fields in minimally-invasive surgery
International Journal of Computer Assisted Radiology and Surgery · 2025
DOI: 10.1007/s11548-025-03429-7 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2025. Verfasst von Samad Barri Khojasteh und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronics, Universidad de Alcala, Alcala de Henares, Madrid, Spain. samad.barri@uah.es. Hauptthemen laut MEDLINE: Imaging, Three-Dimensional, Minimally Invasive Surgical Procedures, Augmented Reality, Laparoscopy. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Universidad de Alcalá.
Abstract (Originalsprache)
Purpose
Minimally-invasive surgery (MIS) reduces the trauma compared to open surgery but is challenging for endophytic lesion localisation. Augmented reality (AR) is a promising assistance, which superimposes a preoperative 3D lesion model onto the MIS images. It requires solving the difficult problem of 3D model to MIS image registration. We propose MIS-NeRF, a neural radiance field (NeRF) which provides high-fidelity intraoperative 3D reconstruction, used to bootstrap iterative closest point (ICP)
registration
Methods Existing NeRF methods break down in MIS because of the moving light source and specular highlights. The proposed MIS-NeRF is adapted to these conditions. First, it incorporates the camera centre as an additional input to the radiance function, which allows MIS-NeRF to handle the moving light source. Second, it uses a modified volume rendering which handles specular highlights. Third, it uses a regularised compound loss to enhance surface reconstruction.
Results
MIS-NeRF was tested on three synthetic datasets and retrospectively on four laparoscopic surgeries. It successfully reconstructed high-fidelity liver and uterus surfaces, reducing common artefacts including high-frequency noise and bumps caused by specular highlights. ICP registration achieved faithful alignment between the preoperative and intraoperative 3D models, with an average error of 3.25 mm, outperforming the second-best method by a $$15\%$$ 15 % margin.
Conclusion
MIS-NeRF improves AR-based lesion localisation by facilitating accurate 3D model registration to multiple MIS images.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electronics, Universidad de Alcala, Alcala de Henares, Madrid, Spain. samad.barri@uah.es.
- Department of Electronics, Universidad de Alcala, Alcala de Henares, Madrid, Spain.
- DIA2M-DRCI, CHU, Clermont-Ferrand, France.
Förderung
- Universidad de Alcalá
Zitieren
APA
Khojasteh, S. B., Fuentes-Jimenez, D., Pizarro, D., Espinel, Y., & Bartoli, A. (2025). MIS-NeRF: neural radiance fields in minimally-invasive surgery. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-025-03429-7
Vancouver
Khojasteh SB, Fuentes-Jimenez D, Pizarro D, Espinel Y, Bartoli A. MIS-NeRF: neural radiance fields in minimally-invasive surgery. International Journal of Computer Assisted Radiology and Surgery. 2025. doi:10.1007/s11548-025-03429-7
BibTeX
@article{Khojasteh2025,
author = {Khojasteh, Samad Barri and Fuentes-Jimenez, David and Pizarro, Daniel and Espinel, Yamid and Bartoli, Adrien},
title = {MIS-NeRF: neural radiance fields in minimally-invasive surgery},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2025},
doi = {10.1007/s11548-025-03429-7}
}
EUVIMED