ChatGPT's learning and reasoning capacity in anesthesiology
Colombian Journal of Anesthesiology · 17.11.2023 · 52 (1)
DOI: 10.5554/22562087.e1092 ↗Kurz gefasst
Fachartikel in der Zeitschrift Colombian Journal of Anesthesiology, online erschienen am 17.11.2023. Verfasst von Gustavo Cruz und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Introduction
Over the past few months, ChatGPT has raised a lot of interest given its ability to perform complex tasks through natural language and conversation. However, its use in clinical decision-making is limited and its application in the field of anesthesiology is unknown.
Objective
To assess ChatGPT’s basic and clinical reasoning and its learning ability in a performance test on general and specific anesthesia topics.
Methods
A three-phase assessment was conducted. Basic knowledge of anesthesia was assessed in the first phase, followed by a review of difficult airway management and, finally, measurement of decision-making ability in ten clinical cases. The second and the third phases were conducted before and after feeding ChatGPT with the 2022 guidelines of the American Society of Anesthesiologists on difficult airway management.
Results
On average, ChatGPT succeded 65% of the time in the first phase and 48% of the time in the second phase. Agreement in clinical cases was 20%, with 90% relevance and 10% error rate. After learning, ChatGPT improved in the second phase, and was correct 59% of the time, with agreement in clinical cases also increasing to 40%.
Conclusions
ChatGPT showed acceptable accuracy in the basic knowledge test, high relevance in the management of specific difficult airway clinical cases, and the ability to improve after learning.
Zitieren
APA
Cruz, G., Pedroza, S., & Ariza, F. (2023). ChatGPT's learning and reasoning capacity in anesthesiology. Colombian Journal of Anesthesiology, 52(1). https://doi.org/10.5554/22562087.e1092
Vancouver
Cruz G, Pedroza S, Ariza F. ChatGPT's learning and reasoning capacity in anesthesiology. Colombian Journal of Anesthesiology. 2023;52(1). doi:10.5554/22562087.e1092
BibTeX
@article{Cruz2023,
author = {Cruz, Gustavo and Pedroza, Santiago and Ariza, Fredy},
title = {ChatGPT's learning and reasoning capacity in anesthesiology},
journal = {Colombian Journal of Anesthesiology},
year = {2023},
volume = {52},
number = {1},
doi = {10.5554/22562087.e1092}
}
EUVIMED