CatSkill: Artificial Intelligence-Based Metrics for the Assessment of Surgical Skill Level from Intraoperative Cataract Surgery Video Recordings
Ophthalmology Science · 2025-07 · 5 (4) · 100764
DOI: 10.1016/j.xops.2025.100764 ↗Kurz gefasst
Fachartikel in der Zeitschrift Ophthalmology Science, 2025-07. Verfasst von Binh Duong Giap und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Ophthalmology & Visual Sciences, Kellogg Eye Center, University of Michigan, Ann Arbor, Michigan. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Doctors Co Foundation, National Institutes of Health.
Abstract (Originalsprache)
Purpose
To develop and validate a novel artificial intelligence (AI)-powered video analysis system to assess surgeon proficiency in maintaining (1) eye neutrality, (2) eye centration, and (3) adequate focus of the operating microscope in cataract surgery and evaluate differences in these metrics between attending cataract surgeons and ophthalmology residents.
Design
A retrospective surgical video analysis. Subjects: Six hundred twenty complete surgical video recordings of 620 cataract surgeries performed by either attending surgeons or ophthalmology residents. Main Outcome Measures: Performance of the proposed AI-powered video analysis system (CatSkill) for cataract surgery was evaluated at multiple stages. Anatomy and surgical landmark segmentation were reported as Dice coefficients. The proposed cataract surgery assessment metrics (CSAMs) were compared between attending and resident surgeons on a phase-wise basis. Surgery-level classification performance (attending vs. resident) of a machine learning (ML) algorithm trained on the CSAMs was assessed using area under the receiver operating characteristic curve (AUC).
Methods
An automated system involving video preprocessing, deep learning-based segmentation with limbus obstruction detection and compensation, and CSAM computation was designed to assess surgeon performance based on surgical videos. Three CSAMs were computed to analyze 430 cataract surgeries (254 attendings and 176 residents). An ML algorithm was developed to predict surgeon training level using only CSAMs.
Results
The CatSkill system using FPN (VGG16) achieved a Dice coefficient of 94.03% for segmentation of palpebral fissure, limbus, and Purkinje image 1. The phase-wise mean CSAM scores were higher for attendings than residents across all surgical phases. Residents struggled with stability/centration during the Main Wound, Cortical Removal, Lens Insertion, and Wound Closure phases, and had difficulty maintaining adequate microscope focus during later phases of surgery. A random forest model using CSAMs achieved an AUC of 0.865 in predicting the skill level (attending or resident) of the surgeon.
Conclusions
The proposed AI-derived CSAMs provide a high level of reliability in assessing the ability of surgeons to maintain eye neutrality, centration, and focus level during cataract surgery. Furthermore, downstream analysis using an ML model for surgical-level classification indicates that the proposed CSAMs provide significant predictive value for assessing the overall training level of the surgeon. Financial Disclosures: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Ophthalmology & Visual Sciences, Kellogg Eye Center, University of Michigan, Ann Arbor, Michigan.
- Department of Vitreo Retinal, Aravind Eye Hospital, Chennai, Tamil Nadu, India.
- Wayne State University School of Medicine, Detroit, Michigan.
- Department of Computational Medicine & Bioinformatics, University of Michigan, Ann Arbor, Michigan.
Förderung
- Doctors Co Foundation
- National Institutes of Health
Zitieren
APA
Giap, B. D., Ballouz, D., Srinivasan, K., Lustre, J., Likosky, K., Mahmoud, O., Mian, S. I., Tannen, B. L., & Nallasamy, N. (2025). CatSkill: Artificial Intelligence-Based Metrics for the Assessment of Surgical Skill Level from Intraoperative Cataract Surgery Video Recordings. Ophthalmology Science, 5(4), 100764. https://doi.org/10.1016/j.xops.2025.100764
Vancouver
Giap BD, Ballouz D, Srinivasan K, Lustre J, Likosky K, Mahmoud O, et al. CatSkill: Artificial Intelligence-Based Metrics for the Assessment of Surgical Skill Level from Intraoperative Cataract Surgery Video Recordings. Ophthalmology Science. 2025;5(4):100764. doi:10.1016/j.xops.2025.100764
BibTeX
@article{Giap2025,
author = {Giap, Binh Duong and Ballouz, Dena and Srinivasan, Karthik and Lustre, Jefferson and Likosky, Keely and Mahmoud, Ossama and Mian, Shahzad I and Tannen, Bradford L and Nallasamy, Nambi},
title = {CatSkill: Artificial Intelligence-Based Metrics for the Assessment of Surgical Skill Level from Intraoperative Cataract Surgery Video Recordings},
journal = {Ophthalmology Science},
year = {2025},
volume = {5},
number = {4},
pages = {100764},
doi = {10.1016/j.xops.2025.100764}
}
EUVIMED