AI-Based Markerless Computer Vision Framework for Open Surgery Skill Assessment: A Prototype Assessment Framework
Surgical Innovation · 14.05.2026
DOI: 10.1177/15533506261451990 ↗Kurz gefasst
Fachartikel in der Zeitschrift Surgical Innovation, online erschienen am 14.05.2026. Verfasst von Alejandro Zulbaran-Rojas und 9 weiteren Autor:innen. Beteiligte Einrichtung: Michael E. DeBakey Department of Surgery, Baylor College of Medicine, Houston, TX, USA. Die Arbeit nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Background
Artificial intelligence (AI) enables hand motion tracking from standard surgical video recordings; however, translating these data into meaningful performance metrics remains challenging. We evaluated the preliminary validity of a markerless, AI-driven system that generates interpretable technical skill scores from an open-surgery task.
Methods
Sixteen medical students and one instructor performed a one-handed knot-tying task recorded with a smartphone camera while wearing motion sensors beneath surgical gloves. A deep learning algorithm tracking 21 hand joints mapped wrist trajectories and generated visualization boundaries from which kinematic parameters were derived and grouped into three domains scored from 0 to 10: economy of motion (EM), flow of motion (FM), and spatial organization (SO). AI metrics were validated against sensor-based data. Parameters and domain scores were correlated with expert-rated product quality (PQ) and technical performance (TP) using validated checklists.
Results
Nineteen performances were analyzed. AI metrics demonstrated strong correlations with sensor-based measures (r = 0.79-0.88, P < 0.01). EM metrics (path length, number of movements, task time) were associated with PQ and TP (r = 0.59-0.67, P < 0.01). Smoothness within the FM domain correlated with PQ and TP (r = 0.56-0.57, P < 0.01), while the composite FM score moderately correlated with TP (r = 0.44, P = 0.057). Working area within the SO domain demonstrated a moderate association with TP (r = 0.41, P = 0.08).
Conclusion
This prototype AI framework translated hand kinematics into interpretable, cohort-normalized domain-level scores that aligned with expert assessment. The findings support the feasibility of video-based kinematic scoring and provide preliminary evidence of construct validity. Further studies are warranted to determine reliability and generalizability.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Michael E. DeBakey Department of Surgery, Baylor College of Medicine, Houston, TX, USA.
- Center for Advanced Surgical and Interventional Technology (CASIT), Department of Surgery, David Geffen College of Medicine, University of California, Los Angeles, CA, USA.
- Surgical Simulation Center, Baylor College of Medicine, Houston, TX, USA.
ORCID-Profile: Alejandro Zulbaran-Rojas, Miguel Bargas-Ochoa, Bijan Najafi
Zitieren
APA
Zulbaran-Rojas, A., Rouzi, M. D., Hansraj, N., Erstad, D., Bargas-Ochoa, M., D'Silva, E., Kirby, R. P., Salas, N., Rojas, Y., & Najafi, B. (2026). AI-Based Markerless Computer Vision Framework for Open Surgery Skill Assessment: A Prototype Assessment Framework. Surgical Innovation. https://doi.org/10.1177/15533506261451990
Vancouver
Zulbaran-Rojas A, Rouzi MD, Hansraj N, Erstad D, Bargas-Ochoa M, D'Silva E, et al. AI-Based Markerless Computer Vision Framework for Open Surgery Skill Assessment: A Prototype Assessment Framework. Surgical Innovation. 2026. doi:10.1177/15533506261451990
BibTeX
@article{ZulbaranRojas2026,
author = {Zulbaran-Rojas, Alejandro and Rouzi, Mohammad Dehghan and Hansraj, Natasha and Erstad, Derek and Bargas-Ochoa, Miguel and D'Silva, Ethan and Kirby, Randall Parker and Salas, Nilson and Rojas, Yesenia and Najafi, Bijan},
title = {AI-Based Markerless Computer Vision Framework for Open Surgery Skill Assessment: A Prototype Assessment Framework},
journal = {Surgical Innovation},
year = {2026},
doi = {10.1177/15533506261451990}
}
EUVIMED