Video‐Based Assessment of Operative Competency in Laparoscopic Cholecystectomy: A Prospective Observational Study to Inform Rubric Design for AI ‐Assisted Evaluation
ANZ Journal of Surgery · 2026
DOI: 10.1111/ans.70398 ↗At a glance
Beobachtungsstudie in ANZ Journal of Surgery, 2026. Written by Yuchen Luo and 6 co-authors. Institution: Division of Surgery, Northern Health, Epping, Victoria, Australia. Major MEDLINE topics: Cholecystectomy, Laparoscopic, Clinical Competence, Video Recording, Artificial Intelligence. Cited 2 times so far (Crossref); 36 references.
Abstract (original language)
Objective
This pilot study aimed to assess the interrater reliability of quantitative measures derived from video‐based evaluation of laparoscopic cholecystectomy performance, with the future aim of developing an objective assessment tool and the use of artificial intelligence for this procedure.
Methods
This study was conducted at a single metropolitan training hospital in Australia. Quantitative metrics based on 30 randomly selected videos were evaluated by three surgeon assessors. Interrater reliability was measured using percent agreement (PA) for categorical items and intraclass correlation coefficient (ICC) models for numerical items.
Results
Interrater agreement varied. For numerical items, moderate agreement was found for Hartmann's pouch grasping, gallbladder rotation, and incorrect clipping; good for perforation; and excellent for time to critical view of safety. Key categorical procedure‐specific items (e.g., 360° cystic duct dissection, two‐window view) achieved at least moderate agreement. Case difficulty assessment showed good to excellent agreement. Registrars demonstrated prolonged time to critical view of safety, more frequent Hartmann's pouch grasping, more gallbladder rotations, and increased instrument insertions. Competency ratings showed 45.8% of registrars as ‘developing’, while consultants were rated predominantly ‘good’ (40%) or ‘excellent’ (20%).
Conclusions
There is potential to develop an objective video‐based evaluation tool for laparoscopic cholecystectomy based on more quantitative assessment items, as evidenced by the interrater reliability results in this pilot study. Further research on artificial intelligence and computer vision will be beneficial in establishing a reliable and valid scoring tool.
Subjects
MeSH terms (MEDLINE)
Authors and institutions
- Division of Surgery, Northern Health, Epping, Victoria, Australia.
- Department of Surgery, University of Melbourne, Epping, Victoria, Australia.
- Research Development and Governance Unit, Northern Health, Epping, Victoria, Australia.
- Research and Industry Engagement, Latrobe University, Epping, Victoria, Australia.
- Department of Surgery, Western Health, Footscray, Victoria, Australia.
- Department of Health and Biomedical Sciences, RMIT, Bundoora, Victoria, Australia.
ORCID profiles: Yuchen Luo, Mani Suleiman, Russell Hodgson
Cite
APA
Luo, Y., Kang, Y. C., Sidhu, A., Suleiman, M., Houli, N., Kumta, S., & Hodgson, R. (2026). Video‐Based Assessment of Operative Competency in Laparoscopic Cholecystectomy: A Prospective Observational Study to Inform Rubric Design for AI ‐Assisted Evaluation. ANZ Journal of Surgery. https://doi.org/10.1111/ans.70398
Vancouver
Luo Y, Kang YC, Sidhu A, Suleiman M, Houli N, Kumta S, et al. Video‐Based Assessment of Operative Competency in Laparoscopic Cholecystectomy: A Prospective Observational Study to Inform Rubric Design for AI ‐Assisted Evaluation. ANZ Journal of Surgery. 2026. doi:10.1111/ans.70398
BibTeX
@article{Luo2026,
author = {Luo, Yuchen and Kang, Yuen Chiu and Sidhu, Ankur and Suleiman, Mani and Houli, Nezor and Kumta, Shekhar and Hodgson, Russell},
title = {Video‐Based Assessment of Operative Competency in Laparoscopic Cholecystectomy: A Prospective Observational Study to Inform Rubric Design for AI ‐Assisted Evaluation},
journal = {ANZ Journal of Surgery},
year = {2026},
doi = {10.1111/ans.70398}
}
EUVIMED