EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Is ChatGPT 3.5 smarter than Otolaryngology trainees? A comparison study of board style exam questions

Jaimin Patel iD, Peyton Robinson, Elisa Illing, Benjamin Anthony

PLOS ONE · 2024

DOI: 10.1371/journal.pone.0306233 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift PLOS ONE, 2024. Verfasst von Jaimin Patel und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Otolaryngology-Head and Neck Surgery, Indiana University School of Medicine, Indianapolis, IN, United States of America. Hauptthemen laut MEDLINE: Otolaryngology, Internship and Residency, Educational Measurement, Students, Medical. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 17 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objectives

This study compares the performance of the artificial intelligence (AI) platform Chat Generative Pre-Trained Transformer (ChatGPT) to Otolaryngology trainees on board-style exam questions.

Methods

We administered a set of 30 Otolaryngology board-style questions to medical students (MS) and Otolaryngology residents (OR). 31 MSs and 17 ORs completed the questionnaire. The same test was administered to ChatGPT version 3.5, five times. Comparisons of performance were achieved using a one-way ANOVA with Tukey Post Hoc test, along with a regression analysis to explore the relationship between education level and performance.

Results

The average scores increased each year from MS1 to PGY5. A one-way ANOVA revealed that ChatGPT outperformed trainee years MS1, MS2, and MS3 (p =

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

OtolaryngologyInternship and ResidencyEducational MeasurementStudents, MedicalHumansSurveys and QuestionnairesArtificial IntelligenceClinical Competence

Autor:innen und Institutionen

  • Department of Otolaryngology-Head and Neck Surgery, Indiana University School of Medicine, Indianapolis, IN, United States of America.
  • Indiana University School of Medicine, Indianapolis, IN, United States of America.

ORCID-Profile: Jaimin Patel

Zitieren

APA

Patel, J., Robinson, P., Illing, E., & Anthony, B. (2024). Is ChatGPT 3.5 smarter than Otolaryngology trainees? A comparison study of board style exam questions. PLOS ONE. https://doi.org/10.1371/journal.pone.0306233

Vancouver

Patel J, Robinson P, Illing E, Anthony B. Is ChatGPT 3.5 smarter than Otolaryngology trainees? A comparison study of board style exam questions. PLOS ONE. 2024. doi:10.1371/journal.pone.0306233

BibTeX
@article{Patel2024,
  author = {Patel, Jaimin and Robinson, Peyton and Illing, Elisa and Anthony, Benjamin},
  title = {Is ChatGPT 3.5 smarter than Otolaryngology trainees? A comparison study of board style exam questions},
  journal = {PLOS ONE},
  year = {2024},
  doi = {10.1371/journal.pone.0306233}
}
Kostenlos starten →