EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Implementing GPT‐4 Learning Models in Dermatology: An Assessment of Medical Quality and Utility

Aryan Naik iD, Peter Vien, Thanh-Nga Tran

Skin Research and Technology · 2026

DOI: 10.1111/srt.70331 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Skin Research and Technology, 2026. Verfasst von Aryan Naik und 2 weiteren Autor:innen. Beteiligte Einrichtung: Larner College of Medicine, The University of Vermont, Burlington, Vermont, USA. Hauptthemen laut MEDLINE: Dermatology, Skin Diseases. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial intelligence, including large language models (LLMs) such as GPT‐4, can generate responses to clinical queries using predictive algorithms trained on large online datasets. Current literature lacks a comprehensive assessment of the medical quality and accuracy of dermatologic GPT‐4‐generated outputs.

Methods

A standardized query was used to ask GPT‐4 models (Copilot and ChatGPT‐4) to generate summaries and treatment recommendations for 33 dermatologic conditions, which were then compared to corresponding sections of UpToDate (UTD) excerpts. DISCERN scores were calculated for each source by two authors (AN and PV). Concordance between GPT‐4‐generated treatments and UTD was evaluated by a certified dermatologist. Word count and Flesch Kincaid reading score were generated in R. Paired t ‐tests and one‐way and weighted ANOVA were conducted in R.

Results

The DISCERN instrument classified UTD content as being of “fair” medical quality (mean [SD], 3.08 [0.34]), while both ChatGPT‐4 and Copilot produced content of “poor” medical quality (mean [SD], 2.28 [0.22] and mean [SD], 2.31 [0.35], respectively). ChatGPT‐4's treatment recommendations demonstrated 33.5% greater average concordance with UTD treatment recommendations (mean [SD], 64.89% [29.29]), in comparison to Copilot (mean [SD], 31.38% [31.08%]); (95% CI, 22.3%–44.7%, p < 0.001).

Conclusions

Overall, GPT‐4 models produced dermatological content with few harmful recommendations. However, GPT‐4‐generated content performed poorly on the DISCERN instrument, and validation of LLM‐generated responses remains challenging. Results suggest LLM parameters and query structures may be optimizable for dermatologic applications. If implemented alongside the professional judgement of certified dermatologists, future LLMs may serve as time‐saving dermatologic tools, enhancing patient care.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

DermatologySkin DiseasesHumansLarge Language ModelsGenerative Artificial IntelligenceArtificial IntelligenceAlgorithms

Stichwörter der Autor:innen

AIAI in dermatologyChatGPTartificial intelligence

Autor:innen und Institutionen

  • Larner College of Medicine, The University of Vermont, Burlington, Vermont, USA.
  • Wellman Center for Photomedicine, Harvard Medical School, Massachusetts General Hospital, Boston, Massachusetts, USA.

ORCID-Profile: Aryan Naik

Zitieren

APA

Naik, A., Vien, P., & Tran, T. N. (2026). Implementing GPT‐4 Learning Models in Dermatology: An Assessment of Medical Quality and Utility. Skin Research and Technology. https://doi.org/10.1111/srt.70331

Vancouver

Naik A, Vien P, Tran TN. Implementing GPT‐4 Learning Models in Dermatology: An Assessment of Medical Quality and Utility. Skin Research and Technology. 2026. doi:10.1111/srt.70331

BibTeX
@article{Naik2026,
  author = {Naik, Aryan and Vien, Peter and Tran, Thanh-Nga},
  title = {Implementing GPT‐4 Learning Models in Dermatology: An Assessment of Medical Quality and Utility},
  journal = {Skin Research and Technology},
  year = {2026},
  doi = {10.1111/srt.70331}
}
Kostenlos starten →