Is ChatGPT 3.5 smarter than Otolaryngology trainees? A comparison study of board style exam questions
PLOS ONE · 2024
DOI: 10.1371/journal.pone.0306233 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift PLOS ONE, 2024. Verfasst von Jaimin Patel und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Otolaryngology-Head and Neck Surgery, Indiana University School of Medicine, Indianapolis, IN, United States of America. Hauptthemen laut MEDLINE: Otolaryngology, Internship and Residency, Educational Measurement, Students, Medical. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 17 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objectives
This study compares the performance of the artificial intelligence (AI) platform Chat Generative Pre-Trained Transformer (ChatGPT) to Otolaryngology trainees on board-style exam questions.
Methods
We administered a set of 30 Otolaryngology board-style questions to medical students (MS) and Otolaryngology residents (OR). 31 MSs and 17 ORs completed the questionnaire. The same test was administered to ChatGPT version 3.5, five times. Comparisons of performance were achieved using a one-way ANOVA with Tukey Post Hoc test, along with a regression analysis to explore the relationship between education level and performance.
Results
The average scores increased each year from MS1 to PGY5. A one-way ANOVA revealed that ChatGPT outperformed trainee years MS1, MS2, and MS3 (p =
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Otolaryngology-Head and Neck Surgery, Indiana University School of Medicine, Indianapolis, IN, United States of America.
- Indiana University School of Medicine, Indianapolis, IN, United States of America.
ORCID-Profile: Jaimin Patel
Zitieren
APA
Patel, J., Robinson, P., Illing, E., & Anthony, B. (2024). Is ChatGPT 3.5 smarter than Otolaryngology trainees? A comparison study of board style exam questions. PLOS ONE. https://doi.org/10.1371/journal.pone.0306233
Vancouver
Patel J, Robinson P, Illing E, Anthony B. Is ChatGPT 3.5 smarter than Otolaryngology trainees? A comparison study of board style exam questions. PLOS ONE. 2024. doi:10.1371/journal.pone.0306233
BibTeX
@article{Patel2024,
author = {Patel, Jaimin and Robinson, Peyton and Illing, Elisa and Anthony, Benjamin},
title = {Is ChatGPT 3.5 smarter than Otolaryngology trainees? A comparison study of board style exam questions},
journal = {PLOS ONE},
year = {2024},
doi = {10.1371/journal.pone.0306233}
}
EUVIMED