EUVIMEDOpdag EUVIMED
Beobachtungsstudie

Video‐Based Assessment of Operative Competency in Laparoscopic Cholecystectomy: A Prospective Observational Study to Inform Rubric Design for AI ‐Assisted Evaluation

Yuchen Luo iD, Yuen Chiu Kang, Ankur Sidhu, Mani Suleiman iD, Nezor Houli, Shekhar Kumta, Russell Hodgson iD

ANZ Journal of Surgery · 2026

DOI: 10.1111/ans.70398 ↗

At a glance

Beobachtungsstudie in ANZ Journal of Surgery, 2026. Written by Yuchen Luo and 6 co-authors. Institution: Division of Surgery, Northern Health, Epping, Victoria, Australia. Major MEDLINE topics: Cholecystectomy, Laparoscopic, Clinical Competence, Video Recording, Artificial Intelligence. Cited 2 times so far (Crossref); 36 references.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Objective

This pilot study aimed to assess the interrater reliability of quantitative measures derived from video‐based evaluation of laparoscopic cholecystectomy performance, with the future aim of developing an objective assessment tool and the use of artificial intelligence for this procedure.

Methods

This study was conducted at a single metropolitan training hospital in Australia. Quantitative metrics based on 30 randomly selected videos were evaluated by three surgeon assessors. Interrater reliability was measured using percent agreement (PA) for categorical items and intraclass correlation coefficient (ICC) models for numerical items.

Results

Interrater agreement varied. For numerical items, moderate agreement was found for Hartmann's pouch grasping, gallbladder rotation, and incorrect clipping; good for perforation; and excellent for time to critical view of safety. Key categorical procedure‐specific items (e.g., 360° cystic duct dissection, two‐window view) achieved at least moderate agreement. Case difficulty assessment showed good to excellent agreement. Registrars demonstrated prolonged time to critical view of safety, more frequent Hartmann's pouch grasping, more gallbladder rotations, and increased instrument insertions. Competency ratings showed 45.8% of registrars as ‘developing’, while consultants were rated predominantly ‘good’ (40%) or ‘excellent’ (20%).

Conclusions

There is potential to develop an objective video‐based evaluation tool for laparoscopic cholecystectomy based on more quantitative assessment items, as evidenced by the interrater reliability results in this pilot study. Further research on artificial intelligence and computer vision will be beneficial in establishing a reliable and valid scoring tool.

Subjects

MeSH terms (MEDLINE)

Cholecystectomy, LaparoscopicClinical CompetenceVideo RecordingArtificial IntelligenceHumansProspective StudiesPilot ProjectsReproducibility of ResultsAustralia

Authors and institutions

  • Division of Surgery, Northern Health, Epping, Victoria, Australia.
  • Department of Surgery, University of Melbourne, Epping, Victoria, Australia.
  • Research Development and Governance Unit, Northern Health, Epping, Victoria, Australia.
  • Research and Industry Engagement, Latrobe University, Epping, Victoria, Australia.
  • Department of Surgery, Western Health, Footscray, Victoria, Australia.
  • Department of Health and Biomedical Sciences, RMIT, Bundoora, Victoria, Australia.

ORCID profiles: Yuchen Luo, Mani Suleiman, Russell Hodgson

Cite

APA

Luo, Y., Kang, Y. C., Sidhu, A., Suleiman, M., Houli, N., Kumta, S., & Hodgson, R. (2026). Video‐Based Assessment of Operative Competency in Laparoscopic Cholecystectomy: A Prospective Observational Study to Inform Rubric Design for AI ‐Assisted Evaluation. ANZ Journal of Surgery. https://doi.org/10.1111/ans.70398

Vancouver

Luo Y, Kang YC, Sidhu A, Suleiman M, Houli N, Kumta S, et al. Video‐Based Assessment of Operative Competency in Laparoscopic Cholecystectomy: A Prospective Observational Study to Inform Rubric Design for AI ‐Assisted Evaluation. ANZ Journal of Surgery. 2026. doi:10.1111/ans.70398

BibTeX
@article{Luo2026,
  author = {Luo, Yuchen and Kang, Yuen Chiu and Sidhu, Ankur and Suleiman, Mani and Houli, Nezor and Kumta, Shekhar and Hodgson, Russell},
  title = {Video‐Based Assessment of Operative Competency in Laparoscopic Cholecystectomy: A Prospective Observational Study to Inform Rubric Design for AI ‐Assisted Evaluation},
  journal = {ANZ Journal of Surgery},
  year = {2026},
  doi = {10.1111/ans.70398}
}
Start for free →