EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Stereo reconstruction from microscopic images for computer-assisted ophthalmic surgery

Rebekka Peter, Sofia Moreira, Eleonora Tagliabue, Matthias Hillenbrand, Rita G Nunes, Franziska Mathis-Ullrich

International Journal of Computer Assisted Radiology and Surgery · 2024

DOI: 10.1007/s11548-024-03177-0 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2024. Verfasst von Rebekka Peter und 5 weiteren Autor:innen. Beteiligte Einrichtung: Carl Zeiss AG, Oberkochen, Germany. rebekka.peter@zeiss.com. Hauptthemen laut MEDLINE: Surgery, Computer-Assisted, Imaging, Three-Dimensional, Ophthalmologic Surgical Procedures, Microscopy. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Carl Zeiss AG.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

This work presents a novel platform for stereo reconstruction in anterior segment ophthalmic surgery to enable enhanced scene understanding, especially depth perception, for advanced computer-assisted eye surgery by effectively addressing the lack of texture and corneal distortions artifacts in the surgical scene.

Methods

The proposed platform for stereo reconstruction uses a two-step approach: generating a sparse 3D point cloud from microscopic images, deriving a dense 3D representation by fitting surfaces onto the point cloud, and considering geometrical priors of the eye anatomy. We incorporate a pre-processing step to rectify distortion artifacts induced by the cornea’s high refractive power, achieved by aligning a 3D phenotypical cornea geometry model to the images and computing a distortion map using ray tracing.

Results

The accuracy of 3D reconstruction is evaluated on stereo microscopic images of ex vivo porcine eyes, rigid phantom eyes, and synthetic photo-realistic images. The results demonstrate the potential of the proposed platform to enhance scene understanding via an accurate 3D representation of the eye and enable the estimation of instrument to layer distances in porcine eyes with a mean average error of 190 $$\upmu {\hbox {m}}$$ μ m , comparable to the scale of surgeons’ hand tremor.

Conclusion

This work marks a significant advancement in stereo reconstruction for ophthalmic surgery by addressing corneal distortions, a previously often overlooked aspect in such surgical scenarios. This could improve surgical outcomes by allowing for intra-operative computer assistance, e.g., in the form of virtual distance sensors.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Surgery, Computer-AssistedImaging, Three-DimensionalOphthalmologic Surgical ProceduresMicroscopyImage Processing, Computer-AssistedSwineAnimalsPhantoms, ImagingCorneaHumans

Stichwörter der Autor:innen

Computer-assisted ophthalmic surgeryDepth estimationDistortion correctionStereo reconstruction

Autor:innen und Institutionen

  • Carl Zeiss AG, Oberkochen, Germany. rebekka.peter@zeiss.com.
  • Laboratory for Surgical Planning and Robotic Cognition (SPARC), Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany. rebekka.peter@zeiss.…
  • Carl Zeiss AG, Oberkochen, Germany.
  • Institute for Systems and Robotics, Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal.
  • Laboratory for Surgical Planning and Robotic Cognition (SPARC), Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.

Förderung

  • Carl Zeiss AG

Zitieren

APA

Peter, R., Moreira, S., Tagliabue, E., Hillenbrand, M., Nunes, R. G., & Mathis-Ullrich, F. (2024). Stereo reconstruction from microscopic images for computer-assisted ophthalmic surgery. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-024-03177-0

Vancouver

Peter R, Moreira S, Tagliabue E, Hillenbrand M, Nunes RG, Mathis-Ullrich F. Stereo reconstruction from microscopic images for computer-assisted ophthalmic surgery. International Journal of Computer Assisted Radiology and Surgery. 2024. doi:10.1007/s11548-024-03177-0

BibTeX
@article{Peter2024,
  author = {Peter, Rebekka and Moreira, Sofia and Tagliabue, Eleonora and Hillenbrand, Matthias and Nunes, Rita G and Mathis-Ullrich, Franziska},
  title = {Stereo reconstruction from microscopic images for computer-assisted ophthalmic surgery},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2024},
  doi = {10.1007/s11548-024-03177-0}
}
Kostenlos starten →