EUVIMEDEUVIMED entdecken
Crossref

Evaluating the diagnostic accuracy of ChatGPT-4 in oral and maxillofacial lesions: a pilot clinical vignette study

A Jain

International Journal of Oral and Maxillofacial Surgery · 2026

DOI: 10.1016/j.ijom.2026.02.004 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Oral and Maxillofacial Surgery, 2026. Verfasst von A Jain. Beteiligte Einrichtung: Department of Oral and Maxillofacial Surgery, Geetanjali Dental and Research Institute, Geetanjali University, Eklingpura, 313001 Udaipur, Rajasthan,…. Die Arbeit nennt 8 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

There is growing interest in whether artificial intelligence (AI) large language models such as ChatGPT-4 can support clinicians and trainees in the diagnosis of oral and maxillofacial surgery (OMFS) lesions. This pilot study evaluated the diagnostic accuracy of ChatGPT-4 in identifying OMFS lesions using standardized clinical vignettes and assessed the clarity of its diagnostic reasoning compared to expert consensus. Fifty diverse clinical vignettes representing a range of OMFS lesions were developed and validated by three oral and maxillofacial surgeons. Each vignette was entered into ChatGPT-4 with a uniform prompt. The AI's 'most likely diagnosis' was compared to expert consensus. Outcomes included overall and category-wise diagnostic accuracy and expert-rated clarity of diagnostic reasoning. ChatGPT-4 showed overall diagnostic accuracy of 70% (35/50), performing best in odontogenic infections (90%) and worst in soft-tissue malignancies (33%). The model's reasoning clarity received an average score of 3.8 out of 5. While ChatGPT-4 excelled in recognizing classical lesion patterns, it showed limitations in interpreting complex cases. ChatGPT-4 demonstrates moderate diagnostic capability for common OMFS lesions and holds promise as an educational tool. However, its limited performance in complex diagnoses underscores the need for domain-specific optimization and expert oversight before any clinical use.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

HumansPilot ProjectsLarge Language ModelsGenerative Artificial IntelligenceFemale

Stichwörter der Autor:innen

Artificial intelligenceMaxillofacial surgeryMouth diseasesNatural language processingOral diagnosis

Autor:innen und Institutionen

  • Department of Oral and Maxillofacial Surgery, Geetanjali Dental and Research Institute, Geetanjali University, Eklingpura, 313001 Udaipur, Rajasthan, India; Department of Dental Research Cell, Dr. D. Y. Patil Dental Col…

Zitieren

APA

Jain, A. (2026). Evaluating the diagnostic accuracy of ChatGPT-4 in oral and maxillofacial lesions: a pilot clinical vignette study. International Journal of Oral and Maxillofacial Surgery. https://doi.org/10.1016/j.ijom.2026.02.004

Vancouver

Jain A. Evaluating the diagnostic accuracy of ChatGPT-4 in oral and maxillofacial lesions: a pilot clinical vignette study. International Journal of Oral and Maxillofacial Surgery. 2026. doi:10.1016/j.ijom.2026.02.004

BibTeX
@article{Jain2026,
  author = {Jain, A},
  title = {Evaluating the diagnostic accuracy of ChatGPT-4 in oral and maxillofacial lesions: a pilot clinical vignette study},
  journal = {International Journal of Oral and Maxillofacial Surgery},
  year = {2026},
  doi = {10.1016/j.ijom.2026.02.004}
}
Kostenlos starten →