EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Differential Diagnosis Performance of ChatGPT in Oral and Maxillofacial Pathology

Sohaib Shujaat iD, Marryam Riaz, Jawaher Mohammed Alsubaie iD, Aljwhrah Abdulaziz Almuammar iD, Arun Pillai, Abdulmohsen Alfadley iD, Ali Anwar Aboalela iD

Oral Diseases · 19.10.2026

DOI: 10.1111/odi.70501 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Oral Diseases, online erschienen am 19.10.2026. Verfasst von Sohaib Shujaat und 6 weiteren Autor:innen. Beteiligte Einrichtung: King Abdullah International Medical Research Center, Department of Maxillofacial Surgery & Diagnostic Sciences, College of Dentistry, King Saud Bin A…. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

To evaluate ChatGPT (GPT‐5.1) for ranked differential diagnoses in oral and maxillofacial pathology, assess image effects on diagnostic performance and examine output stability across repeated runs.

Methods

This retrospective diagnostic accuracy study included 160 biopsy‐confirmed cases. Cases were evaluated using a standardised prompt under two conditions: text‐only and text plus clinical photographs and/or radiographs. Each case underwent three independent runs. Performance was measured using Top‐1, Top‐3, Top‐5 and Top‐10 accuracy.

Results

Top‐1 accuracy was 44.0% for text‐only and 43.3% for text + image inputs. Accuracy increased at broader thresholds, with Top‐10 accuracy reaching 80.7% and 82.9%, respectively, but no significant differences were observed between input conditions at any Top‐K threshold. Top‐1 performance was stable across runs, although variability was observed at broader Top‐K thresholds in the text‐only condition.

Conclusions

ChatGPT ranked the reference diagnosis first in fewer than half of cases, while broader differential lists more often included it. Images did not significantly improve accuracy, although heterogeneous and non‐standardised visual inputs may have limited detection of multimodal effects. These findings support further investigation for hypothesis generation and educational use rather than clinical decision support or replacement of expert judgement and histopathological confirmation.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligencedifferential diagnosislarge language modelsmultimodal inputoral pathology

Autor:innen und Institutionen

  • King Abdullah International Medical Research Center, Department of Maxillofacial Surgery & Diagnostic Sciences, College of Dentistry, King Saud Bin Abdulaziz University for Health Sciences, Ministry of National Guard He…
  • Department of Physiology, Azra Naheed Dental College, Superior University, Lahore, Pakistan.
  • King Abdullah International Medical Research Center, College of Dentistry, King Saud Bin Abdulaziz University for Health Sciences, Ministry of National Guard Health Affairs, Riyadh, Kingdom of Saudi Arabia.
  • King Abdullah International Medical Research Center, Department of Restorative and Prosthetic Dental Sciences, College of Dentistry, King Saud Bin Abdulaziz University for Health Sciences, Ministry of National Guard Hea…

ORCID-Profile: Sohaib Shujaat, Jawaher Mohammed Alsubaie, Aljwhrah Abdulaziz Almuammar, Abdulmohsen Alfadley, Ali Anwar Aboalela

Zitieren

APA

Shujaat, S., Riaz, M., Alsubaie, J. M., Almuammar, A. A., Pillai, A., Alfadley, A., & Aboalela, A. A. (2026). Differential Diagnosis Performance of ChatGPT in Oral and Maxillofacial Pathology. Oral Diseases. https://doi.org/10.1111/odi.70501

Vancouver

Shujaat S, Riaz M, Alsubaie JM, Almuammar AA, Pillai A, Alfadley A, et al. Differential Diagnosis Performance of ChatGPT in Oral and Maxillofacial Pathology. Oral Diseases. 2026. doi:10.1111/odi.70501

BibTeX
@article{Shujaat2026,
  author = {Shujaat, Sohaib and Riaz, Marryam and Alsubaie, Jawaher Mohammed and Almuammar, Aljwhrah Abdulaziz and Pillai, Arun and Alfadley, Abdulmohsen and Aboalela, Ali Anwar},
  title = {Differential Diagnosis Performance of ChatGPT in Oral and Maxillofacial Pathology},
  journal = {Oral Diseases},
  year = {2026},
  doi = {10.1111/odi.70501}
}
Kostenlos starten →