EUVIMEDEUVIMED entdecken
Crossref

Vision-based augmented reality guidance for setting up robot-assisted spine surgery

Blanca Inigo, Sungwoo Kim, Sue Min Cho, Michelle Song, Han Zhang, Ali Uneri, Christopher Bailey, Axel Krieger, Mathias Unberath

International Journal of Computer Assisted Radiology and Surgery · 13.05.2026 · 21 (6) · 1263-1272

DOI: 10.1007/s11548-026-03690-4 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, online erschienen am 13.05.2026. Verfasst von Blanca Inigo und 8 weiteren Autor:innen. Beteiligte Einrichtung: Johns Hopkins University, Baltimore, Maryland, USA. binigo1@jh.edu. Hauptthemen laut MEDLINE: Augmented Reality, Robotic Surgical Procedures, Spine, Surgery, Computer-Assisted. Die Arbeit nennt 25 Literaturangaben. Gefördert von: Foundation for the National Institutes of Health.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

PURPOSE: Robot-assisted procedures improve precision and patient outcomes, but setup often requires tedious manual positioning due to a lack of intuitive guidance. Augmented reality (AR) can assist with coarse alignment by providing visual cues in the correct anatomical context. However, most AR systems require additional setup steps to calibrate the head-mounted displays and imaging systems. We propose an AR guidance approach that uses only RGB video to perform spatial calibration with minimal setup effort. METHODS: We establish a shared coordinate frame between the AR headset and the intraoperative imaging system to enable markerless AR guidance. Inter-device poses are estimated directly from RGB video using a Vision Foundation Model (VFM). To improve calibration accuracy in challenging scenarios, such as partial view overlap and long baselines, we apply multi-frame Umeyama optimization with RANSAC, jointly refining scale, rotation, and translation. This process allows users to align the physical robot with the virtual surgical plan with the necessary accuracy. RESULTS: We evaluate calibration and robot alignment accuracy against an ArUco-based baseline, achieving sub-3 ∘ rotation and 15 mm mean translation error without requiring fiducial markers. We further assessed needle placement using a virtual guide that conveyed both the target trajectory and the robot's actuation limits. In all cases, the resulting alignment was within a range that allowed the robot to perform fine adjustments and accurately reach the planned trajectory. CONCLUSION: Experimental results show that our vision-based calibration enables accurate needle alignment within the robot's workspace while eliminating setup complexity and fiducial dependence. This demonstrates the feasibility of seamless, markerless AR guidance for robotic procedures via vision-based calibration.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Augmented RealityRobotic Surgical ProceduresSpineSurgery, Computer-AssistedHumansCalibrationImaging, Three-Dimensional

Stichwörter der Autor:innen

Computer-assisted interventionImage-guided interventionsMixed realityRobotic navigationSpine surgery

Autor:innen und Institutionen

  • Johns Hopkins University, Baltimore, Maryland, USA. binigo1@jh.edu.
  • Johns Hopkins University, Baltimore, Maryland, USA.
  • Johns Hopkins Hospital, Baltimore, Maryland, USA.
  • Johns Hopkins University, Baltimore, Maryland, USA. mathias@jhu.edu.

Förderung

  • Foundation for the National Institutes of Health

Zitieren

APA

Inigo, B., Kim, S., Cho, S. M., Song, M., Zhang, H., Uneri, A., Bailey, C., Krieger, A., & Unberath, M. (2026). Vision-based augmented reality guidance for setting up robot-assisted spine surgery. International Journal of Computer Assisted Radiology and Surgery, 21(6), 1263-1272. https://doi.org/10.1007/s11548-026-03690-4

Vancouver

Inigo B, Kim S, Cho SM, Song M, Zhang H, Uneri A, et al. Vision-based augmented reality guidance for setting up robot-assisted spine surgery. International Journal of Computer Assisted Radiology and Surgery. 2026;21(6):1263-1272. doi:10.1007/s11548-026-03690-4

BibTeX
@article{Inigo2026,
  author = {Inigo, Blanca and Kim, Sungwoo and Cho, Sue Min and Song, Michelle and Zhang, Han and Uneri, Ali and Bailey, Christopher and Krieger, Axel and Unberath, Mathias},
  title = {Vision-based augmented reality guidance for setting up robot-assisted spine surgery},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2026},
  volume = {21},
  number = {6},
  pages = {1263--1272},
  doi = {10.1007/s11548-026-03690-4}
}
Kostenlos starten →