Performance of ChatGPT in emergency medicine residency exams in Qatar: A comparative analysis with resident physicians
Qatar Medical Journal · 2024 · 2024 (4)
DOI: 10.5339/qmj.2024.61 ↗Kurz gefasst
Fachartikel in der Zeitschrift Qatar Medical Journal, 2024. Verfasst von Haris Iftikhar und 4 weiteren Autor:innen. Beteiligte Einrichtung: Emergency Medicine, Hamad General Hospital, Doha, Qatar *Email: haris.ifti@gmail.com. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Introduction
The inclusion of artificial intelligence (AI) in the healthcare sector has transformed medical practices by introducing innovative techniques for medical education, diagnosis, and treatment strategies. In medical education, the potential of AI to enhance learning and assessment methods is being increasingly recognized. This study aims to evaluate the performance of OpenAI’s Chat Generative Pre-Trained Transformer (ChatGPT) in emergency medicine (EM) residency examinations in Qatar and compare it with the performance of resident physicians.
Methods
A retrospective descriptive study with a mixed-methods design was conducted in August 2023. EM residents’ examination scores were collected and compared with the performance of ChatGPT on the same examinations. The examinations consisted of multiple-choice questions (MCQs) from the same faculty responsible for Qatari Board EM examinations. ChatGPT’s performance on these examinations was analyzed and compared with residents across various postgraduate years (PGY).
Results
The study included 238 emergency department residents from PGY1 to PGY4 and compared their performances with ChatGPT. ChatGPT scored consistently higher than resident groups in all examination categories. However, a notable decline in passing rates was observed among senior residents, indicating a potential misalignment between examination performance and practical competencies. Another likely reason can be the impact of the COVID-19 pandemic on their learning experience, knowledge acquisition, and consolidation.
Conclusion
ChatGPT demonstrated significant proficiency in the theoretical knowledge of EM, outperforming resident physicians in examination settings. This finding suggests the potential of AI as a supplementary tool in medical education.
Autor:innen und Institutionen
- Emergency Medicine, Hamad General Hospital, Doha, Qatar *Email: haris.ifti@gmail.com.
- Department of Medical Education, Hamad Medical Corporation, Doha, Qatar.
Zitieren
APA
Iftikhar, H., Anjum, S., Bhutta, Z. A., Najam, M., & Bashir, K. (2024). Performance of ChatGPT in emergency medicine residency exams in Qatar: A comparative analysis with resident physicians. Qatar Medical Journal, 2024(4). https://doi.org/10.5339/qmj.2024.61
Vancouver
Iftikhar H, Anjum S, Bhutta ZA, Najam M, Bashir K. Performance of ChatGPT in emergency medicine residency exams in Qatar: A comparative analysis with resident physicians. Qatar Medical Journal. 2024;2024(4). doi:10.5339/qmj.2024.61
BibTeX
@article{Iftikhar2024,
author = {Iftikhar, Haris and Anjum, Shahzad and Bhutta, Zain A and Najam, Mavia and Bashir, Khalid},
title = {Performance of ChatGPT in emergency medicine residency exams in Qatar: A comparative analysis with resident physicians},
journal = {Qatar Medical Journal},
year = {2024},
volume = {2024},
number = {4},
doi = {10.5339/qmj.2024.61}
}
EUVIMED