Shared Spatiotemporal Multitask Learning for Simultaneous Surgical Gesture Recognition and Skill Assessment from Minimally Invasive Surgery Videos
Sci · 12.11.2026 · 8 (11) · 369
DOI: 10.3390/sci8110369 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sci, online erschienen am 12.11.2026. Verfasst von Rodrigo Eduardo Arevalo-Ancona und 4 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Instituto Politécnico Nacional, Universidad Nacional Autónoma de México, Secretaría de Ciencia, Humanidades, Tecnología e Innovación.
Abstract (Originalsprache)
The automatic recognition of surgical gestures and the assessment of surgical skills are essential for improving patient safety and optimizing surgical training processes. In this paper, a shared spatiotemporal multitask learning framework for joint surgical gesture recognition and skill assessment from minimally invasive surgery videos is presented. The proposed architecture simultaneously recognizes surgical gestures and estimates the expertise level of the surgeon from surgical video sequences. It is based on a 3D CNN with two parallel branches based on the ResNet18 backbone and incorporates LSTM module to model spatial temporal features from surgical video sequences. In addition, fully connected layers are used to perform surgical gesture classification in one branch and surgical skill level estimation. The experimental evaluation includes surgical gesture recognition and skill assessment using both segmented video clips and full-length surgical videos. The performance of the method is evaluated with the accuracy, precision, recall, and F1-score, for both tasks. These findings suggest that shared spatiotemporal feature learning provides an effective approach for jointly analyzing surgical gestures and skill levels from video.
Förderung
- Instituto Politécnico Nacional
- Universidad Nacional Autónoma de México
- Secretaría de Ciencia, Humanidades, Tecnología e Innovación
- DGAPA
Zitieren
APA
Arevalo-Ancona, R. E., Haro-Mendoza, D., Gonzalez-Villela, V. J., Sanchez-Garcia, J. C., & Cedillo-Hernandez, M. (2026). Shared Spatiotemporal Multitask Learning for Simultaneous Surgical Gesture Recognition and Skill Assessment from Minimally Invasive Surgery Videos. Sci, 8(11), 369. https://doi.org/10.3390/sci8110369
Vancouver
Arevalo-Ancona RE, Haro-Mendoza D, Gonzalez-Villela VJ, Sanchez-Garcia JC, Cedillo-Hernandez M. Shared Spatiotemporal Multitask Learning for Simultaneous Surgical Gesture Recognition and Skill Assessment from Minimally Invasive Surgery Videos. Sci. 2026;8(11):369. doi:10.3390/sci8110369
BibTeX
@article{ArevaloAncona2026,
author = {Arevalo-Ancona, Rodrigo Eduardo and Haro-Mendoza, Daniel and Gonzalez-Villela, Victor J. and Sanchez-Garcia, Juan Carlos and Cedillo-Hernandez, Manuel},
title = {Shared Spatiotemporal Multitask Learning for Simultaneous Surgical Gesture Recognition and Skill Assessment from Minimally Invasive Surgery Videos},
journal = {Sci},
year = {2026},
volume = {8},
number = {11},
pages = {369},
doi = {10.3390/sci8110369}
}
EUVIMED