EUVIMEDEUVIMED entdecken
Open Access

Automatic Surgical Skill Assessment System Based on Concordance of Standardized Surgical Field Development Using Artificial Intelligence

Takahiro Igaki, Daichi Kitaguchi, Hiroki Matsuzaki, Kei Nakajima, Shigehiro Kojima, Hiro Hasegawa, Nobuyoshi Takeshita, Yusuke Kinugasa, Masaaki Ito

JAMA Surgery · 09.08.2023 · 158 (8) · e231131

DOI: 10.1001/jamasurg.2023.1131 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JAMA Surgery, online erschienen am 09.08.2023. Verfasst von Takahiro Igaki und 8 weiteren Autor:innen. Beteiligte Einrichtung: Surgical Device Innovation Office, National Cancer Center Hospital East, Kashiwanoha, Kashiwa, Chiba, Japan. Hauptthemen laut MEDLINE: Laparoscopy, Digestive System Surgical Procedures. Die Arbeit wurde bisher 95-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Importance Automatic surgical skill assessment with artificial intelligence (AI) is more objective than manual video review–based skill assessment and can reduce human burden. Standardization of surgical field development is an important aspect of this skill assessment.

Objective

To develop a deep learning model that can recognize the standardized surgical fields in laparoscopic sigmoid colon resection and to evaluate the feasibility of automatic surgical skill assessment based on the concordance of the standardized surgical field development using the proposed deep learning model. Design, Setting, and Participants This retrospective diagnostic study used intraoperative videos of laparoscopic colorectal surgery submitted to the Japan Society for Endoscopic Surgery between August 2016 and November 2017. Data were analyzed from April 2020 to September 2022.

Interventions

Videos of surgery performed by expert surgeons with Endoscopic Surgical Skill Qualification System (ESSQS) scores higher than 75 were used to construct a deep learning model able to recognize a standardized surgical field and output its similarity to standardized surgical field development as an AI confidence score (AICS). Other videos were extracted as the validation set. Main Outcomes and Measures Videos with scores less than or greater than 2 SDs from the mean were defined as the low- and high-score groups, respectively. The correlation between AICS and ESSQS score and the screening performance using AICS for low- and high-score groups were analyzed.

Results

The sample included 650 intraoperative videos, 60 of which were used for model construction and 60 for validation. The Spearman rank correlation coefficient between the AICS and ESSQS score was 0.81. The receiver operating characteristic (ROC) curves for the screening of the low- and high-score groups were plotted, and the areas under the ROC curve for the low- and high-score group screening were 0.93 and 0.94, respectively. Conclusions and Relevance The AICS from the developed model strongly correlated with the ESSQS score, demonstrating the model’s feasibility for use as a method of automatic surgical skill assessment. The findings also suggest the feasibility of the proposed model for creating an automated screening system for surgical skills and its potential application to other types of endoscopic procedures.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

LaparoscopyDigestive System Surgical ProceduresHumansArtificial IntelligenceRetrospective StudiesROC Curve

Autor:innen und Institutionen

  • Surgical Device Innovation Office, National Cancer Center Hospital East, Kashiwanoha, Kashiwa, Chiba, Japan.
  • Department of Colorectal Surgery, National Cancer Center Hospital East, Kashiwanoha, Kashiwa, Chiba, Japan.
  • Department of Gastrointestinal Surgery, Tokyo Medical and Dental University Graduate School of Medicine, Yushima, Bunkyo-Ku, Tokyo, Japan.

Zitieren

APA

Igaki, T., Kitaguchi, D., Matsuzaki, H., Nakajima, K., Kojima, S., Hasegawa, H., Takeshita, N., Kinugasa, Y., & Ito, M. (2023). Automatic Surgical Skill Assessment System Based on Concordance of Standardized Surgical Field Development Using Artificial Intelligence. JAMA Surgery, 158(8), e231131. https://doi.org/10.1001/jamasurg.2023.1131

Vancouver

Igaki T, Kitaguchi D, Matsuzaki H, Nakajima K, Kojima S, Hasegawa H, et al. Automatic Surgical Skill Assessment System Based on Concordance of Standardized Surgical Field Development Using Artificial Intelligence. JAMA Surgery. 2023;158(8):e231131. doi:10.1001/jamasurg.2023.1131

BibTeX
@article{Igaki2023,
  author = {Igaki, Takahiro and Kitaguchi, Daichi and Matsuzaki, Hiroki and Nakajima, Kei and Kojima, Shigehiro and Hasegawa, Hiro and Takeshita, Nobuyoshi and Kinugasa, Yusuke and Ito, Masaaki},
  title = {Automatic Surgical Skill Assessment System Based on Concordance of Standardized Surgical Field Development Using Artificial Intelligence},
  journal = {JAMA Surgery},
  year = {2023},
  volume = {158},
  number = {8},
  pages = {e231131},
  doi = {10.1001/jamasurg.2023.1131}
}
Kostenlos starten →