Automated machine learning assessment and feedback for the Fundamentals of Laparoscopic Surgery peg transfer task
Artificial Intelligence Surgery · 19.11.2026 · 6 (4) · 697-709
DOI: 10.20517/ais.2026.72 ↗Kurz gefasst
Fachartikel in der Zeitschrift Artificial Intelligence Surgery, online erschienen am 19.11.2026. Verfasst von Divya Kewalramani und 13 weiteren Autor:innen. Die Arbeit nennt 34 Literaturangaben.
Abstract (Originalsprache)
Aim
Whereas computer vision has advanced the capabilities of Fundamentals of Laparoscopic Surgery (FLS) trainers, real-time coaching using machine learning (ML) remains limited. This retrospective proof-of-concept study evaluated whether an ML model could provide automated FLS pass/fail assessment comparable to faculty, using pre-recorded videos.
Methods
Residents performed video-recorded FLS peg transfers scored pass/fail. A training set of 60 videos (51 standard cases, 9 edge-case videos) was used to develop a multi-stage pipeline combining a “you only look once” (YOLOv8n) object detector, and a deterministic rule engine encoding FLS pass/fail criteria. The model was evaluated on 24 resident-disjoint, held-out videos. A faculty majority-vote reference standard was set by five evaluators per video. Model predictions were compared against this reference standard.
Results
The ML model classified outcomes accurately in 92% of cases [95%CI: 74%-98%; F1 score = 0.93 (pass positive); Cohen’s κ = 0.83]. Total analysis time was 6 min vs. approximately 56 min of video playback. The model concurrently identified errors in 70% (31/44) of error events, with 97% (30/31) concordance in error classification. Among the 13 remaining events, the model preceded the faculty-annotated timestamp in 8/13 (62%). Real-time instructional prompts were implemented in a heads-up display but not evaluated here.
Conclusion
The system provided accurate FLS peg-transfer assessment comparable to faculty while reducing evaluation time. As a retrospective proof-of-concept, it supports automated assessment and, pending prospective validation, could deliver scalable real-time feedback in skills training. External validation in larger, multi-institutional cohorts should precede adoption.
Zitieren
APA
Kewalramani, D., Hu, A., Xue, Y., Nunez, R., Kliewer, F., Cai, J., Getrajdman, J., Patel, N. M., Koleilat, I., Barie, P. S., Madani, A., Roshan, U., Narayan, M., & Bongu, A. (2026). Automated machine learning assessment and feedback for the Fundamentals of Laparoscopic Surgery peg transfer task. Artificial Intelligence Surgery, 6(4), 697-709. https://doi.org/10.20517/ais.2026.72
Vancouver
Kewalramani D, Hu A, Xue Y, Nunez R, Kliewer F, Cai J, et al. Automated machine learning assessment and feedback for the Fundamentals of Laparoscopic Surgery peg transfer task. Artificial Intelligence Surgery. 2026;6(4):697-709. doi:10.20517/ais.2026.72
BibTeX
@article{Kewalramani2026,
author = {Kewalramani, Divya and Hu, Andrew and Xue, Yunzhe and Nunez, Ricardo and Kliewer, Finn and Cai, Jenny and Getrajdman, Joelle and Patel, Nell Maloney and Koleilat, Issam and Barie, Philip S. and Madani, Amin and Roshan, Usman and Narayan, Mayur and Bongu, Advaith},
title = {Automated machine learning assessment and feedback for the Fundamentals of Laparoscopic Surgery peg transfer task},
journal = {Artificial Intelligence Surgery},
year = {2026},
volume = {6},
number = {4},
pages = {697--709},
doi = {10.20517/ais.2026.72}
}
EUVIMED