Progression of an Artificial Intelligence Chatbot (ChatGPT) for Pediatric Cardiology Educational Knowledge Assessment
Pediatric Cardiology · 2024
DOI: 10.1007/s00246-023-03385-6 ↗Kurz gefasst
Fachartikel in der Zeitschrift Pediatric Cardiology, 2024. Verfasst von Michael N Gritti und 3 weiteren Autor:innen. Beteiligte Einrichtung: Division of Cardiology, The Labatt Family Heart Centre, The Hospital for Sick Children, 555 University Ave, Toronto, ON, M5G 1X8, Canada. michael.gri…. Hauptthemen laut MEDLINE: Medicine, Cardiology. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 21 Literaturangaben.
Abstract (Originalsprache)
Artificial intelligence chatbots, like ChatGPT, have become powerful tools that are disrupting how humans interact with technology. The potential uses within medicine are vast. In medical education, these chatbots have shown improvements, in a short time span, in generalized medical examinations. We evaluated the overall performance and improvement between ChatGPT 3.5 and 4.0 in a test of pediatric cardiology knowledge. ChatGPT 3.5 and ChatGPT 4.0 were used to answer text-based multiple-choice questions derived from a Pediatric Cardiology Board Review textbook. Each chatbot was given an 88 question test, subcategorized into 11 topics. We excluded questions with modalities other than text (sound clips or images). Statistical analysis was done using an unpaired two-tailed t-test. Of the same 88 questions, ChatGPT 4.0 answered 66% of the questions correctly (n = 58/88) which was significantly greater (p < 0.0001) than ChatGPT 3.5, which only answered 38% (33/88). The ChatGPT 4.0 version also did better on each subspeciality topic as compared to ChatGPT 3.5. While acknowledging that ChatGPT does not yet offer subspecialty level knowledge in pediatric cardiology, the performance in pediatric cardiology educational assessments showed a considerable improvement in a short period of time between ChatGPT 3.5 and 4.0.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Cardiology, The Labatt Family Heart Centre, The Hospital for Sick Children, 555 University Ave, Toronto, ON, M5G 1X8, Canada. michael.gritti@sickkids.ca.
- Department of Pediatrics, University of Toronto, Toronto, ON, Canada. michael.gritti@sickkids.ca.
- Department of Pediatrics, University of Toronto, Toronto, ON, Canada.
- Department of Pediatrics, The Hospital for Sick Children, Toronto, ON, Canada.
- Division of Cardiology, The Labatt Family Heart Centre, The Hospital for Sick Children, 555 University Ave, Toronto, ON, M5G 1X8, Canada.
- Schulich School of Medicine and Dentistry, University of Western Ontario, London, ON, Canada.
Zitieren
APA
Gritti, M. N., AlTurki, H., Farid, P., & Morgan, C. T. (2024). Progression of an Artificial Intelligence Chatbot (ChatGPT) for Pediatric Cardiology Educational Knowledge Assessment. Pediatric Cardiology. https://doi.org/10.1007/s00246-023-03385-6
Vancouver
Gritti MN, AlTurki H, Farid P, Morgan CT. Progression of an Artificial Intelligence Chatbot (ChatGPT) for Pediatric Cardiology Educational Knowledge Assessment. Pediatric Cardiology. 2024. doi:10.1007/s00246-023-03385-6
BibTeX
@article{Gritti2024,
author = {Gritti, Michael N and AlTurki, Hussain and Farid, Pedrom and Morgan, Conall T},
title = {Progression of an Artificial Intelligence Chatbot (ChatGPT) for Pediatric Cardiology Educational Knowledge Assessment},
journal = {Pediatric Cardiology},
year = {2024},
doi = {10.1007/s00246-023-03385-6}
}
EUVIMED