EUVIMEDEUVIMED entdecken
Randomisierte kontrollierte StudieOpen Access

AI in Surgical Curriculum Design and Unintended Outcomes for Technical Competencies in Simulation Training

Ali M Fazlollahi, Recai Yilmaz, Alexander Winkler-Schwartz, Nykan Mirchi, Nicole Ledwos, Mohamad Bakhaidar, Ahmad Alsayegh, Rolando F Del Maestro

JAMA Network Open · 19.09.2023 · 6 (9) · e2334658

DOI: 10.1001/jamanetworkopen.2023.34658 ↗

Kurz gefasst

Randomisierte kontrollierte Studie in der Zeitschrift JAMA Network Open, online erschienen am 19.09.2023. Verfasst von Ali M Fazlollahi und 7 weiteren Autor:innen. Beteiligte Einrichtung: Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and H…. Hauptthemen laut MEDLINE: Simulation Training, Neoplasms. Die Arbeit wurde bisher 90-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Importance To better elucidate the role of artificial intelligence (AI) in surgical skills training requires investigations in the potential existence of a hidden curriculum.

Objective

To assess the pedagogical value of AI-selected technical competencies and their extended effects in surgical simulation training. Design, Setting, and Participants This cohort study was a follow-up of a randomized clinical trial conducted at the Neurosurgical Simulation and Artificial Intelligence Learning Centre at the Montreal Neurological Institute, McGill University, Montreal, Canada. Surgical performance metrics of medical students exposed to an AI-enhanced training curriculum were compared with a control group of participants who received no feedback and with expert benchmarks. Cross-sectional data were collected from January to April 2021 from medical students and from March 2015 to May 2016 from experts. This follow-up secondary analysis was conducted from June to September 2022. Participants included medical students (undergraduate year 0-2) in the intervention cohorts and neurosurgeons to establish expertise benchmarks. Exposure Performance assessment and personalized feedback by an intelligent tutor on 4 AI-selected learning objectives during simulation training. Main Outcomes and Measures Outcomes of interest were unintended performance outcomes, measured by significant within-participant difference from baseline in 270 performance metrics in the intervention cohort that was not observed in the control cohort.

Results

A total of 46 medical students (median [range] age, 22 [18-27] years; 27 [59%] women) and 14 surgeons (median [range] age, 45 [35-59] years; 14 [100%] men) were included in this study, and no participant was lost to follow-up. Feedback on 4 AI-selected technical competencies was associated with additional performance change in 32 metrics over the entire procedure and 20 metrics during tumor removal that was not observed in the control group. Participants exposed to the AI-enhanced curriculum demonstrated significant improvement in safety metrics, such as reducing the rate of healthy tissue removal (mean difference, −7.05 × 10 −5 [95% CI, −1.09 × 10 −4 to −3.14 × 10 −5 ] mm 3 per 20 ms; P < .001) and maintaining a focused bimanual control of the operative field (mean difference in maximum instrument divergence, −4.99 [95% CI, −8.48 to −1.49] mm, P = .006) compared with the control group. However, negative unintended effects were also observed. These included a significantly lower velocity and acceleration in the dominant hand (velocity: mean difference, −0.13 [95% CI, −0.17 to −0.09] mm per 20 ms; P < .001; acceleration: mean difference, −2.25 × 10 −2 [95% CI, −3.20 × 10 −2 to −1.31 × 10 −2 ] mm per 20 ms 2 ; P < .001) and a significant reduction in the rate of tumor removal (mean difference, −4.85 × 10 −5 [95% CI, −7.22 × 10 −5 to −2.48 × 10 −5 ] mm 3 per 20 ms; P < .001) compared with control. These unintended outcomes diverged students’ movement and efficiency performance metrics away from the expertise benchmarks. Conclusions and Relevance In this cohort study of medical students, an AI-enhanced curriculum for bimanual surgical skills resulted in unintended changes that improved performance in safety but negatively affected some efficiency metrics. Incorporating AI in course design requires ongoing assessment to maintain transparency and foster evidence-based learning objectives.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Simulation TrainingNeoplasmsMaleFemaleHumansYoung AdultAdultMiddle AgedArtificial IntelligenceCohort StudiesCross-Sectional StudiesCurriculum

Autor:innen und Institutionen

  • Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology and Neurosurgery, Montreal Neurological Institute and Hospital, McGill University, Montreal, Quebec, Canada.
  • Faculty of Medicine and Health Sciences, McGill University, Montreal, Quebec, Canada.
  • Division of Neurosurgery, Department of Surgery, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia.

Zitieren

APA

Fazlollahi, A. M., Yilmaz, R., Winkler-Schwartz, A., Mirchi, N., Ledwos, N., Bakhaidar, M., Alsayegh, A., & Del Maestro, R. F. (2023). AI in Surgical Curriculum Design and Unintended Outcomes for Technical Competencies in Simulation Training. JAMA Network Open, 6(9), e2334658. https://doi.org/10.1001/jamanetworkopen.2023.34658

Vancouver

Fazlollahi AM, Yilmaz R, Winkler-Schwartz A, Mirchi N, Ledwos N, Bakhaidar M, et al. AI in Surgical Curriculum Design and Unintended Outcomes for Technical Competencies in Simulation Training. JAMA Network Open. 2023;6(9):e2334658. doi:10.1001/jamanetworkopen.2023.34658

BibTeX
@article{Fazlollahi2023,
  author = {Fazlollahi, Ali M and Yilmaz, Recai and Winkler-Schwartz, Alexander and Mirchi, Nykan and Ledwos, Nicole and Bakhaidar, Mohamad and Alsayegh, Ahmad and Del Maestro, Rolando F},
  title = {AI in Surgical Curriculum Design and Unintended Outcomes for Technical Competencies in Simulation Training},
  journal = {JAMA Network Open},
  year = {2023},
  volume = {6},
  number = {9},
  pages = {e2334658},
  doi = {10.1001/jamanetworkopen.2023.34658}
}
Kostenlos starten →