EUVIMEDEUVIMED entdecken
Crossref

Head motion-corrected eye gaze tracking with the da Vinci surgical system

Alexandre Banks, Alaa Eldin Abdelaal, Septimiu Salcudean

International Journal of Computer Assisted Radiology and Surgery · 2024

DOI: 10.1007/s11548-024-03173-4 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2024. Verfasst von Alexandre Banks und 2 weiteren Autor:innen. Beteiligte Einrichtung: Electrical and Computer Engineering Department, University of British Columbia, Main Mall, Vancouver, BC, V6T 1Z4, Canada. albanks@student.ubc.ca. Hauptthemen laut MEDLINE: Robotic Surgical Procedures, Eye-Tracking Technology, Head Movements, Algorithms. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 18 Literaturangaben. Gefördert von: Natural Sciences and Engineering Research Council of Canada.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

PURPOSE: To facilitate the integration of point of gaze (POG) as an input modality for robot-assisted surgery, we introduce a robust head movement compensation gaze tracking system for the da Vinci Surgical System. Previous surgical eye gaze trackers require multiple recalibrations and suffer from accuracy loss when users move from the calibrated position. We investigate whether eye corner detection can reduce gaze estimation error in a robotic surgery context. METHODS: A polynomial regressor is first used to estimate POG after an 8-point calibration, and then, using another regressor, the POG error from head movement is estimated from the shift in 2D eye corner location. Eye corners are computed by first detecting regions of interest using the You Only Look Once (YOLO) object detector trained on 1600 annotated eye images (open dataset included). Contours are then extracted from the bounding boxes and a derivative-based curvature detector refines the eye corner. RESULTS: Through a user study (n = 24), our corner-contingent head compensation algorithm showed an error reduction in degrees of visual angle of 1.20 ∘ (p = 0.037) for the left eye and 1.26 ∘ (p = 0.079) for the right compared to the previous gold-standard POG error correction method. In addition, the eye corner pipeline showed a root-mean-squared error of 3.57 (SD = 1.92) pixels in detecting eye corners over 201 annotated frames. CONCLUSION: We introduce an effective method of using eye corners to correct for eye gaze estimation, enabling the practical acquisition of POG in robotic surgery.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Robotic Surgical ProceduresEye-Tracking TechnologyHead MovementsAlgorithmsHumansEye MovementsMaleFemaleFixation, OcularAdultCalibration

Stichwörter der Autor:innen

Da VinciEye landmark detectionPoint of gazeSurgical robots

Autor:innen und Institutionen

  • Electrical and Computer Engineering Department, University of British Columbia, Main Mall, Vancouver, BC, V6T 1Z4, Canada. albanks@student.ubc.ca.
  • Electrical and Computer Engineering Department, University of British Columbia, Main Mall, Vancouver, BC, V6T 1Z4, Canada.
  • Mechanical Engineering Department, Stanford University, Escondido Mall, Stanford, CA, 94305, USA.

Förderung

  • Natural Sciences and Engineering Research Council of Canada

Zitieren

APA

Banks, A., Eldin Abdelaal, A., & Salcudean, S. (2024). Head motion-corrected eye gaze tracking with the da Vinci surgical system. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-024-03173-4

Vancouver

Banks A, Eldin Abdelaal A, Salcudean S. Head motion-corrected eye gaze tracking with the da Vinci surgical system. International Journal of Computer Assisted Radiology and Surgery. 2024. doi:10.1007/s11548-024-03173-4

BibTeX
@article{Banks2024,
  author = {Banks, Alexandre and Eldin Abdelaal, Alaa and Salcudean, Septimiu},
  title = {Head motion-corrected eye gaze tracking with the da Vinci surgical system},
  journal = {International Journal of Computer Assisted Radiology and Surgery},
  year = {2024},
  doi = {10.1007/s11548-024-03173-4}
}
Kostenlos starten →