EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MIS-NeRF: neural radiance fields in minimally-invasive surgery

Samad Barri Khojasteh, David Fuentes-Jimenez, Daniel Pizarro, Yamid Espinel, Adrien Bartoli

International Journal of Computer Assisted Radiology and Surgery · 2025

DOI: 10.1007/s11548-025-03429-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2025. Verfasst von Samad Barri Khojasteh und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronics, Universidad de Alcala, Alcala de Henares, Madrid, Spain. samad.barri@uah.es. Hauptthemen laut MEDLINE: Imaging, Three-Dimensional, Minimally Invasive Surgical Procedures, Augmented Reality, Laparoscopy. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Universidad de Alcalá.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

Minimally-invasive surgery (MIS) reduces the trauma compared to open surgery but is challenging for endophytic lesion localisation. Augmented reality (AR) is a promising assistance, which superimposes a preoperative 3D lesion model onto the MIS images. It requires solving the difficult problem of 3D model to MIS image registration. We propose MIS-NeRF, a neural radiance field (NeRF) which provides high-fidelity intraoperative 3D reconstruction, used to bootstrap iterative closest point (ICP)

registration

Methods Existing NeRF methods break down in MIS because of the moving light source and specular highlights. The proposed MIS-NeRF is adapted to these conditions. First, it incorporates the camera centre as an additional input to the radiance function, which allows MIS-NeRF to handle the moving light source. Second, it uses a modified volume rendering which handles specular highlights. Third, it uses a regularised compound loss to enhance surface reconstruction.

Results

MIS-NeRF was tested on three synthetic datasets and retrospectively on four laparoscopic surgeries. It successfully reconstructed high-fidelity liver and uterus surfaces, reducing common artefacts including high-frequency noise and bumps caused by specular highlights. ICP registration achieved faithful alignment between the preoperative and intraoperative 3D models, with an average error of 3.25 mm, outperforming the second-best method by a $$15\%$$ 15 % margin.

Conclusion

MIS-NeRF improves AR-based lesion localisation by facilitating accurate 3D model registration to multiple MIS images.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Imaging, Three-DimensionalMinimally Invasive Surgical ProceduresAugmented RealityLaparoscopySurgery, Computer-AssistedHumansRetrospective StudiesFemale

Stichwörter der Autor:innen

3D–2D registrationIntraoperative 3D reconstructionLaparoscopyLiver

Autor:innen und Institutionen

  • Department of Electronics, Universidad de Alcala, Alcala de Henares, Madrid, Spain. samad.barri@uah.es.
  • Department of Electronics, Universidad de Alcala, Alcala de Henares, Madrid, Spain.
  • DIA2M-DRCI, CHU, Clermont-Ferrand, France.

Förderung

  • Universidad de Alcalá

Zitieren

APA

Khojasteh, S. B., Fuentes-Jimenez, D., Pizarro, D., Espinel, Y., & Bartoli, A. (2025). MIS-NeRF: neural radiance fields in minimally-invasive surgery. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-025-03429-7

Vancouver

Khojasteh SB, Fuentes-Jimenez D, Pizarro D, Espinel Y, Bartoli A. MIS-NeRF: neural radiance fields in minimally-invasive surgery. International Journal of Computer Assisted Radiology and Surgery. 2025. doi:10.1007/s11548-025-03429-7

BibTeX
@article{Khojasteh2025,
  author = {Khojasteh, Samad Barri and Fuentes-Jimenez, David and Pizarro, Daniel and Espinel, Yamid and Bartoli, Adrien},
  title = {MIS-NeRF: neural radiance fields in minimally-invasive surgery},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2025},
  doi = {10.1007/s11548-025-03429-7}
}
Kostenlos starten →