EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

ChatGPT's learning and reasoning capacity in anesthesiology

Gustavo Cruz, Santiago Pedroza, Fredy Ariza

Colombian Journal of Anesthesiology · 17.11.2023 · 52 (1)

DOI: 10.5554/22562087.e1092 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Colombian Journal of Anesthesiology, online erschienen am 17.11.2023. Verfasst von Gustavo Cruz und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Over the past few months, ChatGPT has raised a lot of interest given its ability to perform complex tasks through natural language and conversation. However, its use in clinical decision-making is limited and its application in the field of anesthesiology is unknown.

Objective

To assess ChatGPT’s basic and clinical reasoning and its learning ability in a performance test on general and specific anesthesia topics.

Methods

A three-phase assessment was conducted. Basic knowledge of anesthesia was assessed in the first phase, followed by a review of difficult airway management and, finally, measurement of decision-making ability in ten clinical cases. The second and the third phases were conducted before and after feeding ChatGPT with the 2022 guidelines of the American Society of Anesthesiologists on difficult airway management.

Results

On average, ChatGPT succeded 65% of the time in the first phase and 48% of the time in the second phase. Agreement in clinical cases was 20%, with 90% relevance and 10% error rate. After learning, ChatGPT improved in the second phase, and was correct 59% of the time, with agreement in clinical cases also increasing to 40%.

Conclusions

ChatGPT showed acceptable accuracy in the basic knowledge test, high relevance in the management of specific difficult airway clinical cases, and the ability to improve after learning.

Zitieren

APA

Cruz, G., Pedroza, S., & Ariza, F. (2023). ChatGPT's learning and reasoning capacity in anesthesiology. Colombian Journal of Anesthesiology, 52(1). https://doi.org/10.5554/22562087.e1092

Vancouver

Cruz G, Pedroza S, Ariza F. ChatGPT's learning and reasoning capacity in anesthesiology. Colombian Journal of Anesthesiology. 2023;52(1). doi:10.5554/22562087.e1092

BibTeX
@article{Cruz2023,
  author = {Cruz, Gustavo and Pedroza, Santiago and Ariza, Fredy},
  title = {ChatGPT's learning and reasoning capacity in anesthesiology},
  journal = {Colombian Journal of Anesthesiology},
  year = {2023},
  volume = {52},
  number = {1},
  doi = {10.5554/22562087.e1092}
}
Kostenlos starten →