Vision-based augmented reality guidance for setting up robot-assisted spine surgery
International Journal of Computer Assisted Radiology and Surgery · 13.05.2026 · 21 (6) · 1263-1272
DOI: 10.1007/s11548-026-03690-4 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, online erschienen am 13.05.2026. Verfasst von Blanca Inigo und 8 weiteren Autor:innen. Beteiligte Einrichtung: Johns Hopkins University, Baltimore, Maryland, USA. binigo1@jh.edu. Hauptthemen laut MEDLINE: Augmented Reality, Robotic Surgical Procedures, Spine, Surgery, Computer-Assisted. Die Arbeit nennt 25 Literaturangaben. Gefördert von: Foundation for the National Institutes of Health.
Abstract (Originalsprache)
PURPOSE: Robot-assisted procedures improve precision and patient outcomes, but setup often requires tedious manual positioning due to a lack of intuitive guidance. Augmented reality (AR) can assist with coarse alignment by providing visual cues in the correct anatomical context. However, most AR systems require additional setup steps to calibrate the head-mounted displays and imaging systems. We propose an AR guidance approach that uses only RGB video to perform spatial calibration with minimal setup effort. METHODS: We establish a shared coordinate frame between the AR headset and the intraoperative imaging system to enable markerless AR guidance. Inter-device poses are estimated directly from RGB video using a Vision Foundation Model (VFM). To improve calibration accuracy in challenging scenarios, such as partial view overlap and long baselines, we apply multi-frame Umeyama optimization with RANSAC, jointly refining scale, rotation, and translation. This process allows users to align the physical robot with the virtual surgical plan with the necessary accuracy. RESULTS: We evaluate calibration and robot alignment accuracy against an ArUco-based baseline, achieving sub-3 ∘ rotation and 15 mm mean translation error without requiring fiducial markers. We further assessed needle placement using a virtual guide that conveyed both the target trajectory and the robot's actuation limits. In all cases, the resulting alignment was within a range that allowed the robot to perform fine adjustments and accurately reach the planned trajectory. CONCLUSION: Experimental results show that our vision-based calibration enables accurate needle alignment within the robot's workspace while eliminating setup complexity and fiducial dependence. This demonstrates the feasibility of seamless, markerless AR guidance for robotic procedures via vision-based calibration.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Johns Hopkins University, Baltimore, Maryland, USA. binigo1@jh.edu.
- Johns Hopkins University, Baltimore, Maryland, USA.
- Johns Hopkins Hospital, Baltimore, Maryland, USA.
- Johns Hopkins University, Baltimore, Maryland, USA. mathias@jhu.edu.
Förderung
- Foundation for the National Institutes of Health
Zitieren
APA
Inigo, B., Kim, S., Cho, S. M., Song, M., Zhang, H., Uneri, A., Bailey, C., Krieger, A., & Unberath, M. (2026). Vision-based augmented reality guidance for setting up robot-assisted spine surgery. International Journal of Computer Assisted Radiology and Surgery, 21(6), 1263-1272. https://doi.org/10.1007/s11548-026-03690-4
Vancouver
Inigo B, Kim S, Cho SM, Song M, Zhang H, Uneri A, et al. Vision-based augmented reality guidance for setting up robot-assisted spine surgery. International Journal of Computer Assisted Radiology and Surgery. 2026;21(6):1263-1272. doi:10.1007/s11548-026-03690-4
BibTeX
@article{Inigo2026,
author = {Inigo, Blanca and Kim, Sungwoo and Cho, Sue Min and Song, Michelle and Zhang, Han and Uneri, Ali and Bailey, Christopher and Krieger, Axel and Unberath, Mathias},
title = {Vision-based augmented reality guidance for setting up robot-assisted spine surgery},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2026},
volume = {21},
number = {6},
pages = {1263--1272},
doi = {10.1007/s11548-026-03690-4}
}
EUVIMED