Egocentric video analysis for automated assessment of open surgical skills via deep learning
International Journal of Computer Assisted Radiology and Surgery · 2025
DOI: 10.1007/s11548-025-03518-7 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Assisted Radiology and Surgery, 2025. Verfasst von Athanasios Gazis und 4 weiteren Autor:innen. Beteiligte Einrichtung: Laboratory of Medical Physics, Medical School, National and Kapodistrian University of Athens, Mikras Asias 75, 11527, Athens, Attiki, Greece. Hauptthemen laut MEDLINE: Deep Learning, Clinical Competence, Video Recording, Suture Techniques. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 34 Literaturangaben.
Abstract (Originalsprache)
PURPOSE: While significant progress has been made in skill assessment for minimally invasive procedures, objective evaluation methods for open surgery remain limited. This paper presents a deep learning framework for assessing technical surgical skills using egocentric video data from open surgery training. METHODS: Our dataset includes 201 videos and corresponding hand kinematics data from three fundamental training task-knot tying (KT), continuous suturing (CS), and interrupted suturing (IS)-performed by 20 participants. Each video was annotated by two experts using a modified OSATS scale (KT: five criteria, total score range: 5-25; CS/IS: seven criteria, total score range: 7-35). We evaluate three temporal architectures (LSTM, TCN, and Transformer), each using ResNet50 as the backbone for spatial feature extraction, and assess them under various training strategies: single-task learning, feature concatenation, pretraining, and multi-task learning with integrated kinematic data. Performance metrics included mean absolute error (MAE) and Spearman correlation coefficient ( ρ ), both with respect to total score prediction. RESULTS: The Transformer-based models consistently outperformed LSTM and TCN across all tasks. The multi-task Transformer incorporating prediction of task completion time ( Transf-MT T+S ) achieved the lowest MAE (KT: 1.92, CS: 2.81, and IS: 2.89) and ρ = 0.84- - 0.90. It also demonstrated promising capabilities for early skill assessment by predicting the total score from partial observations-particularly for simpler tasks. Additionally, we show that models trained on consensus expert ratings outperform those trained on individual annotations, highlighting the value of multi-rater ground truth. CONCLUSION: This research provides a foundation for objective, automated assessment of open surgical skills, with potential to improve the efficiency and standardization of surgical training.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Laboratory of Medical Physics, Medical School, National and Kapodistrian University of Athens, Mikras Asias 75, 11527, Athens, Attiki, Greece.
- 1st Department of Surgery, Laikon General Hospital, National and Kapodistrian University of Athens, Agiou Thoma 17, 11527, Athens, Attiki, Greece.
- Laboratory of Medical Physics, Medical School, National and Kapodistrian University of Athens, Mikras Asias 75, 11527, Athens, Attiki, Greece. cloukas@med.uoa.gr.
ORCID-Profile: Athanasios Gazis, Dimitrios Schizas, Stylianos Kykalos, Pantelis Karaiskos
Zitieren
APA
Gazis, A., Schizas, D., Kykalos, S., Karaiskos, P., & Loukas, C. (2025). Egocentric video analysis for automated assessment of open surgical skills via deep learning. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-025-03518-7
Vancouver
Gazis A, Schizas D, Kykalos S, Karaiskos P, Loukas C. Egocentric video analysis for automated assessment of open surgical skills via deep learning. International Journal of Computer Assisted Radiology and Surgery. 2025. doi:10.1007/s11548-025-03518-7
BibTeX
@article{Gazis2025,
author = {Gazis, Athanasios and Schizas, Dimitrios and Kykalos, Stylianos and Karaiskos, Pantelis and Loukas, Constantinos},
title = {Egocentric video analysis for automated assessment of open surgical skills via deep learning},
journal = {International Journal of Computer Assisted Radiology and Surgery},
year = {2025},
doi = {10.1007/s11548-025-03518-7}
}
EUVIMED