EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Performance of AI in Dermatology Exams: The Exam Success and Limits of ChatGPT

Neşe Göçer Gürok iD, Savaş Öztürk iD

Journal of Cosmetic Dermatology · 2025

DOI: 10.1111/jocd.70244 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Cosmetic Dermatology, 2025. Verfasst von Neşe Göçer Gürok und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Dermatology, Elazığ Fethi Sekin City Health Application and Research Center, University of Health Sciences, Elazig, Turkey. Hauptthemen laut MEDLINE: Dermatology, Internship and Residency, Educational Measurement, Artificial Intelligence. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 14 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial intelligence holds significant potential in dermatology.

Objectives

This study aimed to explore the potential and limitations of artificial intelligence applications in dermatology education by evaluating ChatGPT's performance on questions from the dermatology residency exam.

Method

In this study, the dermatology residency exam results for ChatGPT versions 3.5 and 4.0 were compared with those of resident doctors across various seniority levels. Dermatology resident doctors were categorized into four seniority levels based on their education, and a total of 100 questions—25 multiple‐choice questions for each seniority level—were included in the exam. The same questions were also administered to ChatGPT versions 3.5 and 4.0, and the scores were analyzed statistically.

Results

ChatGPT 3.5 performed poorly, especially when compared to senior residents. Second ( p = 0.038), third ( p = 0.041), and fourth‐year senior resident physicians ( p = 0.020) scored significantly higher than ChatGPT 3.5. ChatGPT 4.0 showed similar performance compared to first‐ and third‐year senior resident physicians, but performed worse in comparison to second ( p = 0.037) and fourth‐year senior resident physicians ( p = 0.029). Both versions scored lower as seniority and exam difficulty increased. ChatGPT 3.5 passed the first and second‐year exams but failed the third and fourth‐year exams. ChatGPT 4.0 passed the first, second, and third‐year exams but failed the fourth‐year exam. These findings suggest that ChatGPT was not on par with senior resident physicians, particularly on topics requiring advanced knowledge; however, version 4.0 proved to be more effective than version 3.5.

Conclusion

In the future, as ChatGPT's language support and knowledge of medicine improve, it can be used more effectively in educational processes.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

DermatologyInternship and ResidencyEducational MeasurementArtificial IntelligenceHumansClinical CompetenceGenerative Artificial Intelligence

Stichwörter der Autor:innen

AIChatGPTartificial intelligencedermatology educationexam

Autor:innen und Institutionen

  • Department of Dermatology, Elazığ Fethi Sekin City Health Application and Research Center, University of Health Sciences, Elazig, Turkey.

ORCID-Profile: Neşe Göçer Gürok, Savaş Öztürk

Zitieren

APA

Göçer Gürok, N., & Öztürk, S. (2025). The Performance of AI in Dermatology Exams: The Exam Success and Limits of ChatGPT. Journal of Cosmetic Dermatology. https://doi.org/10.1111/jocd.70244

Vancouver

Göçer Gürok N, Öztürk S. The Performance of AI in Dermatology Exams: The Exam Success and Limits of ChatGPT. Journal of Cosmetic Dermatology. 2025. doi:10.1111/jocd.70244

BibTeX
@article{GerGrok2025,
  author = {Göçer Gürok, Neşe and Öztürk, Savaş},
  title = {The Performance of AI in Dermatology Exams: The Exam Success and Limits of ChatGPT},
  journal = {Journal of Cosmetic Dermatology},
  year = {2025},
  doi = {10.1111/jocd.70244}
}
Kostenlos starten →