Comparative Analysis of ChatGPT ‐3.5 and GPT ‐4 in Open‐Ended Clinical Reasoning Across Dental Specialties
European Journal of Dental Education · 2026-05 · 30 (2) · 526-532
DOI: 10.1111/eje.13144 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift European Journal of Dental Education, online erschienen am 13.06.2025. Verfasst von Yasamin Babaee Hemmati und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Orthodontics, Dental Sciences Research Center, School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran. Hauptthemen laut MEDLINE: Specialties, Dental, Clinical Reasoning, Education, Dental. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 27 Literaturangaben. Gefördert von: Guilan University of Medical Sciences.
Abstract (Originalsprache)
Purpose
The integration of large language models (LLMs) such as ChatGPT into health care has garnered increasing interest. While previous studies have assessed these models using structured multiple‐choice questions, limited research has evaluated their performance on open‐ended, scenario‐based clinical tasks, particularly in dentistry. This study aimed to evaluate and compare the clinical reasoning capabilities of ChatGPT‐3.5 and GPT‐4 in formulating treatment plans across seven dental specialties using realistic, open‐ended clinical scenarios.
Methods
A cross‐sectional analytical study, reported in accordance with the STROBE guidelines, was conducted using 70 dental cases spanning endodontics, oral and maxillofacial surgery, oral medicine, orthodontics, paediatric dentistry, periodontology, and radiology. Each case was submitted to both ChatGPT‐3.5 and GPT‐4 (paid version, November 2024). Responses were evaluated by specialty‐specific expert panels using a three‐level rubric (poor, average, good). Statistical analyses included chi‐square tests and Fisher–Freeman–Halton exact tests (α = 0.05).
Results
GPT‐4 significantly outperformed GPT‐3.5 in overall response quality (67.1% vs. 44.3% rated as ‘good’; p = 0.016). Although no significant differences were observed across most specialties, GPT‐4 showed a statistically superior performance in oral and maxillofacial surgery. Its advantage was more pronounced in complex cases, aligning with the model's enhanced contextual reasoning.
Conclusion
GPT‐4 demonstrated superior accuracy and consistency compared to GPT‐3.5, particularly in clinically complex and integrative tasks. These findings support the potential of advanced LLMs as adjunct tools in dental education and decision‐making, though specialty‐specific applications and expert oversight remain essential.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Orthodontics, Dental Sciences Research Center, School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran.
- School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran.
- Department of Prosthodontics, Dental Sciences Research Center, School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran.
ORCID-Profile: Yasamin Babaee Hemmati, Mehran Falahchai
Förderung
- Guilan University of Medical Sciences
Zitieren
APA
Babaee Hemmati, Y., Rasouli, M., & Falahchai, M. (2026). Comparative Analysis of ChatGPT ‐3.5 and GPT ‐4 in Open‐Ended Clinical Reasoning Across Dental Specialties. European Journal of Dental Education, 30(2), 526-532. https://doi.org/10.1111/eje.13144
Vancouver
Babaee Hemmati Y, Rasouli M, Falahchai M. Comparative Analysis of ChatGPT ‐3.5 and GPT ‐4 in Open‐Ended Clinical Reasoning Across Dental Specialties. European Journal of Dental Education. 2026;30(2):526-532. doi:10.1111/eje.13144
BibTeX
@article{BabaeeHemmati2026,
author = {Babaee Hemmati, Yasamin and Rasouli, Morteza and Falahchai, Mehran},
title = {Comparative Analysis of ChatGPT ‐3.5 and GPT ‐4 in Open‐Ended Clinical Reasoning Across Dental Specialties},
journal = {European Journal of Dental Education},
year = {2026},
volume = {30},
number = {2},
pages = {526--532},
doi = {10.1111/eje.13144}
}
EUVIMED