The Performance of AI in Dermatology Exams: The Exam Success and Limits of ChatGPT
Journal of Cosmetic Dermatology · 2025
DOI: 10.1111/jocd.70244 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Cosmetic Dermatology, 2025. Verfasst von Neşe Göçer Gürok und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Dermatology, Elazığ Fethi Sekin City Health Application and Research Center, University of Health Sciences, Elazig, Turkey. Hauptthemen laut MEDLINE: Dermatology, Internship and Residency, Educational Measurement, Artificial Intelligence. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 14 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Artificial intelligence holds significant potential in dermatology.
Objectives
This study aimed to explore the potential and limitations of artificial intelligence applications in dermatology education by evaluating ChatGPT's performance on questions from the dermatology residency exam.
Method
In this study, the dermatology residency exam results for ChatGPT versions 3.5 and 4.0 were compared with those of resident doctors across various seniority levels. Dermatology resident doctors were categorized into four seniority levels based on their education, and a total of 100 questions—25 multiple‐choice questions for each seniority level—were included in the exam. The same questions were also administered to ChatGPT versions 3.5 and 4.0, and the scores were analyzed statistically.
Results
ChatGPT 3.5 performed poorly, especially when compared to senior residents. Second ( p = 0.038), third ( p = 0.041), and fourth‐year senior resident physicians ( p = 0.020) scored significantly higher than ChatGPT 3.5. ChatGPT 4.0 showed similar performance compared to first‐ and third‐year senior resident physicians, but performed worse in comparison to second ( p = 0.037) and fourth‐year senior resident physicians ( p = 0.029). Both versions scored lower as seniority and exam difficulty increased. ChatGPT 3.5 passed the first and second‐year exams but failed the third and fourth‐year exams. ChatGPT 4.0 passed the first, second, and third‐year exams but failed the fourth‐year exam. These findings suggest that ChatGPT was not on par with senior resident physicians, particularly on topics requiring advanced knowledge; however, version 4.0 proved to be more effective than version 3.5.
Conclusion
In the future, as ChatGPT's language support and knowledge of medicine improve, it can be used more effectively in educational processes.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Dermatology, Elazığ Fethi Sekin City Health Application and Research Center, University of Health Sciences, Elazig, Turkey.
ORCID-Profile: Neşe Göçer Gürok, Savaş Öztürk
Zitieren
APA
Göçer Gürok, N., & Öztürk, S. (2025). The Performance of AI in Dermatology Exams: The Exam Success and Limits of ChatGPT. Journal of Cosmetic Dermatology. https://doi.org/10.1111/jocd.70244
Vancouver
Göçer Gürok N, Öztürk S. The Performance of AI in Dermatology Exams: The Exam Success and Limits of ChatGPT. Journal of Cosmetic Dermatology. 2025. doi:10.1111/jocd.70244
BibTeX
@article{GerGrok2025,
author = {Göçer Gürok, Neşe and Öztürk, Savaş},
title = {The Performance of AI in Dermatology Exams: The Exam Success and Limits of ChatGPT},
journal = {Journal of Cosmetic Dermatology},
year = {2025},
doi = {10.1111/jocd.70244}
}
EUVIMED