ChatGPT versus clinician: challenging the diagnostic capabilities of artificial intelligence in dermatology
Clinical and Experimental Dermatology · 25.06.2024 · 49 (7) · 707-710
DOI: 10.1093/ced/llad402 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Clinical and Experimental Dermatology, online erschienen am 19.11.2023. Verfasst von Sophie Stoneham und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Dermatology, Royal South Hants Hospital, University Hospitals Southampton, Southampton, UK. Hauptthemen laut MEDLINE: Dermatology, Skin Diseases, Artificial Intelligence, Deep Learning. Die Arbeit wurde bisher 55-mal zitiert (Crossref) und nennt 8 Literaturangaben.
Abstract (Originalsprache)
Background
ChatGPT is an online language-based platform designed to answer questions in a human-like way, using deep learning technology.
Objectives
To examine the diagnostic capabilities of ChatGPT using real-world anonymized medical dermatology cases.
Methods
Clinical information from 90 consecutive patients referred to a single dermatology emergency clinic between June and December 2022 were examined. Thirty-six patients were included. Anonymized clinical information was transcribed and input into ChatGPT 4.0 followed by the question ‘What is the most likely diagnosis?’ The suggested diagnosis made by ChatGPT was then compared with the diagnosis made by dermatology.
Results
After inputting clinical history and examination data obtained by a dermatologist, ChatGPT made a correct primary diagnosis 56% of the time (n = 20). Using the clinical history and cutaneous signs recorded by nonspecialists, it was able to make a correct diagnosis 39% of the time (n = 14). This was similar to the diagnostic rate of nonspecialists (36%; n = 13), but it was much lower than that of dermatologists (83%; n = 30). There was no differential offered by referring sources 28% of the time (n = 10), unlike ChatGPT, which provided a differential diagnosis 100% of the time. Qualitative analysis showed that ChatGPT offered responses with caution, often justifying its reasoning.
Conclusions
This study illustrates that while ChatGPT has a diagnostic capability, in its current form it does not significantly improve the diagnostic yield in primary or secondary care.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Dermatology, Royal South Hants Hospital, University Hospitals Southampton, Southampton, UK.
- Department of Dermatology, St Mary's Hospital, Portsmouth Hospitals University NHS Trust, Portsmouth, UK.
Zitieren
APA
Stoneham, S., Livesey, A., Cooper, H., & Mitchell, C. (2024). ChatGPT versus clinician: challenging the diagnostic capabilities of artificial intelligence in dermatology. Clinical and Experimental Dermatology, 49(7), 707-710. https://doi.org/10.1093/ced/llad402
Vancouver
Stoneham S, Livesey A, Cooper H, Mitchell C. ChatGPT versus clinician: challenging the diagnostic capabilities of artificial intelligence in dermatology. Clinical and Experimental Dermatology. 2024;49(7):707-710. doi:10.1093/ced/llad402
BibTeX
@article{Stoneham2024,
author = {Stoneham, Sophie and Livesey, Amy and Cooper, Hywel and Mitchell, Charles},
title = {ChatGPT versus clinician: challenging the diagnostic capabilities of artificial intelligence in dermatology},
journal = {Clinical and Experimental Dermatology},
year = {2024},
volume = {49},
number = {7},
pages = {707--710},
doi = {10.1093/ced/llad402}
}
EUVIMED