Integrating Video and Objective Performance Data: Development of VORTEX-SPV for Assessing Robotic Lobectomy Skills
Innovations: Technology and Techniques in Cardiothoracic and Vascular Surgery · 2026
DOI: 10.1177/15569845251407699 ↗Kurz gefasst
Fachartikel in der Zeitschrift Innovations: Technology and Techniques in Cardiothoracic and Vascular Surgery, 2026. Verfasst von Alyssa D Murillo und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgery, University of California San Francisco (UCSF), CA, USA. Hauptthemen laut MEDLINE: Robotic Surgical Procedures, Clinical Competence, Pulmonary Veins, Pneumonectomy. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objective
Surgical education requires assessment tools as part of competency-based education (CBE). In robotic surgery, objective performance indicators (OPIs) are a novel objective method of measuring surgeon performance. We developed V ideo and O bjective R obotic T ask E valuation inde X on S uperior P ulmonary V ein dissection (VORTEX-SPV), combining video review and OPIs, to assess cardiothoracic (CT) fellow competency on SPV dissection during lobectomy.
Methods
CT fellows performed robotic lobectomy on an ex vivo perfused porcine model. Synchronized video and kinematic data were captured. Seven thoracic surgery attendings completed the robotic lobectomy to provide expert-level OPI data. VORTEX-SPV is a 12-item assessment with 4 performance levels including completion, safety, economy of motion, and optimized performance. We scored video-based review items (items 1 to 6) as 0 or 1 with an inter-rater agreement of 91%. We calculated OPIs from 6 categories (e.g., wrist articulation, instrument movement, energy, smoothness, clutching, instrument time) as within (1) or beyond (0) 2 standard deviations of the expert mean. We used Rasch modeling and item response theory to evaluate reliability and validity.
Results
We assessed 2 cohorts of CT fellows (2019, n = 50; 2023, n = 59). There were 60% (65 of 109) who had complete data. Reliability was high (expected a posteriori = 0.90). Fourteen trainees scored up to the level of completion, 10 at safety, 17 at economy of motion, and 24 achieved optimized performance. All items appropriately increased in difficulty (Spearman’s rho coefficient = 0.93).
Conclusions
VORTEX-SPV combines video review and objective performance data with strong reliability and validity evidence, serving as a robotic surgery assessment framework to facilitate CBE.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Surgery, University of California San Francisco (UCSF), CA, USA.
- Department of Surgery, University of Southern California, Los Angeles, CA, USA.
ORCID-Profile: Alyssa D Murillo, Riley Brian, Camilla Gomes, Laleh Foroutani, Daniel S Oh
Zitieren
APA
Murillo, A. D., Brian, R., Gomes, C., Foroutani, L., Ganjouei, A. A., Chern, H., O'Sullivan, P. S., & Oh, D. S. (2026). Integrating Video and Objective Performance Data: Development of VORTEX-SPV for Assessing Robotic Lobectomy Skills. Innovations: Technology and Techniques in Cardiothoracic and Vascular Surgery. https://doi.org/10.1177/15569845251407699
Vancouver
Murillo AD, Brian R, Gomes C, Foroutani L, Ganjouei AA, Chern H, et al. Integrating Video and Objective Performance Data: Development of VORTEX-SPV for Assessing Robotic Lobectomy Skills. Innovations: Technology and Techniques in Cardiothoracic and Vascular Surgery. 2026. doi:10.1177/15569845251407699
BibTeX
@article{Murillo2026,
author = {Murillo, Alyssa D and Brian, Riley and Gomes, Camilla and Foroutani, Laleh and Ganjouei, Amir Ashraf and Chern, Hueylan and O'Sullivan, Patricia S and Oh, Daniel S},
title = {Integrating Video and Objective Performance Data: Development of VORTEX-SPV for Assessing Robotic Lobectomy Skills},
journal = {Innovations: Technology and Techniques in Cardiothoracic and Vascular Surgery},
year = {2026},
doi = {10.1177/15569845251407699}
}
EUVIMED