Differential Diagnosis Performance of ChatGPT in Oral and Maxillofacial Pathology
Oral Diseases · 19.10.2026
DOI: 10.1111/odi.70501 ↗Kurz gefasst
Fachartikel in der Zeitschrift Oral Diseases, online erschienen am 19.10.2026. Verfasst von Sohaib Shujaat und 6 weiteren Autor:innen. Beteiligte Einrichtung: King Abdullah International Medical Research Center, Department of Maxillofacial Surgery & Diagnostic Sciences, College of Dentistry, King Saud Bin A…. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objective
To evaluate ChatGPT (GPT‐5.1) for ranked differential diagnoses in oral and maxillofacial pathology, assess image effects on diagnostic performance and examine output stability across repeated runs.
Methods
This retrospective diagnostic accuracy study included 160 biopsy‐confirmed cases. Cases were evaluated using a standardised prompt under two conditions: text‐only and text plus clinical photographs and/or radiographs. Each case underwent three independent runs. Performance was measured using Top‐1, Top‐3, Top‐5 and Top‐10 accuracy.
Results
Top‐1 accuracy was 44.0% for text‐only and 43.3% for text + image inputs. Accuracy increased at broader thresholds, with Top‐10 accuracy reaching 80.7% and 82.9%, respectively, but no significant differences were observed between input conditions at any Top‐K threshold. Top‐1 performance was stable across runs, although variability was observed at broader Top‐K thresholds in the text‐only condition.
Conclusions
ChatGPT ranked the reference diagnosis first in fewer than half of cases, while broader differential lists more often included it. Images did not significantly improve accuracy, although heterogeneous and non‐standardised visual inputs may have limited detection of multimodal effects. These findings support further investigation for hypothesis generation and educational use rather than clinical decision support or replacement of expert judgement and histopathological confirmation.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- King Abdullah International Medical Research Center, Department of Maxillofacial Surgery & Diagnostic Sciences, College of Dentistry, King Saud Bin Abdulaziz University for Health Sciences, Ministry of National Guard He…
- Department of Physiology, Azra Naheed Dental College, Superior University, Lahore, Pakistan.
- King Abdullah International Medical Research Center, College of Dentistry, King Saud Bin Abdulaziz University for Health Sciences, Ministry of National Guard Health Affairs, Riyadh, Kingdom of Saudi Arabia.
- King Abdullah International Medical Research Center, Department of Restorative and Prosthetic Dental Sciences, College of Dentistry, King Saud Bin Abdulaziz University for Health Sciences, Ministry of National Guard Hea…
ORCID-Profile: Sohaib Shujaat, Jawaher Mohammed Alsubaie, Aljwhrah Abdulaziz Almuammar, Abdulmohsen Alfadley, Ali Anwar Aboalela
Zitieren
APA
Shujaat, S., Riaz, M., Alsubaie, J. M., Almuammar, A. A., Pillai, A., Alfadley, A., & Aboalela, A. A. (2026). Differential Diagnosis Performance of ChatGPT in Oral and Maxillofacial Pathology. Oral Diseases. https://doi.org/10.1111/odi.70501
Vancouver
Shujaat S, Riaz M, Alsubaie JM, Almuammar AA, Pillai A, Alfadley A, et al. Differential Diagnosis Performance of ChatGPT in Oral and Maxillofacial Pathology. Oral Diseases. 2026. doi:10.1111/odi.70501
BibTeX
@article{Shujaat2026,
author = {Shujaat, Sohaib and Riaz, Marryam and Alsubaie, Jawaher Mohammed and Almuammar, Aljwhrah Abdulaziz and Pillai, Arun and Alfadley, Abdulmohsen and Aboalela, Ali Anwar},
title = {Differential Diagnosis Performance of ChatGPT in Oral and Maxillofacial Pathology},
journal = {Oral Diseases},
year = {2026},
doi = {10.1111/odi.70501}
}
EUVIMED