Head motion-corrected eye gaze tracking with the da Vinci surgical system
International Journal of Computer Assisted Radiology and Surgery · 2024
DOI: 10.1007/s11548-024-03173-4 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2024. Verfasst von Alexandre Banks und 2 weiteren Autor:innen. Beteiligte Einrichtung: Electrical and Computer Engineering Department, University of British Columbia, Main Mall, Vancouver, BC, V6T 1Z4, Canada. albanks@student.ubc.ca. Hauptthemen laut MEDLINE: Robotic Surgical Procedures, Eye-Tracking Technology, Head Movements, Algorithms. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 18 Literaturangaben. Gefördert von: Natural Sciences and Engineering Research Council of Canada.
Abstract (Originalsprache)
PURPOSE: To facilitate the integration of point of gaze (POG) as an input modality for robot-assisted surgery, we introduce a robust head movement compensation gaze tracking system for the da Vinci Surgical System. Previous surgical eye gaze trackers require multiple recalibrations and suffer from accuracy loss when users move from the calibrated position. We investigate whether eye corner detection can reduce gaze estimation error in a robotic surgery context. METHODS: A polynomial regressor is first used to estimate POG after an 8-point calibration, and then, using another regressor, the POG error from head movement is estimated from the shift in 2D eye corner location. Eye corners are computed by first detecting regions of interest using the You Only Look Once (YOLO) object detector trained on 1600 annotated eye images (open dataset included). Contours are then extracted from the bounding boxes and a derivative-based curvature detector refines the eye corner. RESULTS: Through a user study (n = 24), our corner-contingent head compensation algorithm showed an error reduction in degrees of visual angle of 1.20 ∘ (p = 0.037) for the left eye and 1.26 ∘ (p = 0.079) for the right compared to the previous gold-standard POG error correction method. In addition, the eye corner pipeline showed a root-mean-squared error of 3.57 (SD = 1.92) pixels in detecting eye corners over 201 annotated frames. CONCLUSION: We introduce an effective method of using eye corners to correct for eye gaze estimation, enabling the practical acquisition of POG in robotic surgery.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Electrical and Computer Engineering Department, University of British Columbia, Main Mall, Vancouver, BC, V6T 1Z4, Canada. albanks@student.ubc.ca.
- Electrical and Computer Engineering Department, University of British Columbia, Main Mall, Vancouver, BC, V6T 1Z4, Canada.
- Mechanical Engineering Department, Stanford University, Escondido Mall, Stanford, CA, 94305, USA.
Förderung
- Natural Sciences and Engineering Research Council of Canada
Zitieren
APA
Banks, A., Eldin Abdelaal, A., & Salcudean, S. (2024). Head motion-corrected eye gaze tracking with the da Vinci surgical system. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-024-03173-4
Vancouver
Banks A, Eldin Abdelaal A, Salcudean S. Head motion-corrected eye gaze tracking with the da Vinci surgical system. International Journal of Computer Assisted Radiology and Surgery. 2024. doi:10.1007/s11548-024-03173-4
BibTeX
@article{Banks2024,
author = {Banks, Alexandre and Eldin Abdelaal, Alaa and Salcudean, Septimiu},
title = {Head motion-corrected eye gaze tracking with the da Vinci surgical system},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2024},
doi = {10.1007/s11548-024-03173-4}
}
EUVIMED