EUVIMEDEUVIMED entdecken
Vergleichsstudie

Comparative Analysis of ChatGPT ‐3.5 and GPT ‐4 in Open‐Ended Clinical Reasoning Across Dental Specialties

Yasamin Babaee Hemmati iD, Morteza Rasouli, Mehran Falahchai iD

European Journal of Dental Education · 2026-05 · 30 (2) · 526-532

DOI: 10.1111/eje.13144 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift European Journal of Dental Education, online erschienen am 13.06.2025. Verfasst von Yasamin Babaee Hemmati und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Orthodontics, Dental Sciences Research Center, School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran. Hauptthemen laut MEDLINE: Specialties, Dental, Clinical Reasoning, Education, Dental. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 27 Literaturangaben. Gefördert von: Guilan University of Medical Sciences.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

The integration of large language models (LLMs) such as ChatGPT into health care has garnered increasing interest. While previous studies have assessed these models using structured multiple‐choice questions, limited research has evaluated their performance on open‐ended, scenario‐based clinical tasks, particularly in dentistry. This study aimed to evaluate and compare the clinical reasoning capabilities of ChatGPT‐3.5 and GPT‐4 in formulating treatment plans across seven dental specialties using realistic, open‐ended clinical scenarios.

Methods

A cross‐sectional analytical study, reported in accordance with the STROBE guidelines, was conducted using 70 dental cases spanning endodontics, oral and maxillofacial surgery, oral medicine, orthodontics, paediatric dentistry, periodontology, and radiology. Each case was submitted to both ChatGPT‐3.5 and GPT‐4 (paid version, November 2024). Responses were evaluated by specialty‐specific expert panels using a three‐level rubric (poor, average, good). Statistical analyses included chi‐square tests and Fisher–Freeman–Halton exact tests (α = 0.05).

Results

GPT‐4 significantly outperformed GPT‐3.5 in overall response quality (67.1% vs. 44.3% rated as ‘good’; p = 0.016). Although no significant differences were observed across most specialties, GPT‐4 showed a statistically superior performance in oral and maxillofacial surgery. Its advantage was more pronounced in complex cases, aligning with the model's enhanced contextual reasoning.

Conclusion

GPT‐4 demonstrated superior accuracy and consistency compared to GPT‐3.5, particularly in clinically complex and integrative tasks. These findings support the potential of advanced LLMs as adjunct tools in dental education and decision‐making, though specialty‐specific applications and expert oversight remain essential.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Specialties, DentalClinical ReasoningEducation, DentalHumansCross-Sectional StudiesClinical CompetenceGenerative Artificial Intelligence

Stichwörter der Autor:innen

dental caredental educationlarge language models

Autor:innen und Institutionen

  • Department of Orthodontics, Dental Sciences Research Center, School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran.
  • School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran.
  • Department of Prosthodontics, Dental Sciences Research Center, School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran.

ORCID-Profile: Yasamin Babaee Hemmati, Mehran Falahchai

Förderung

  • Guilan University of Medical Sciences

Zitieren

APA

Babaee Hemmati, Y., Rasouli, M., & Falahchai, M. (2026). Comparative Analysis of ChatGPT ‐3.5 and GPT ‐4 in Open‐Ended Clinical Reasoning Across Dental Specialties. European Journal of Dental Education, 30(2), 526-532. https://doi.org/10.1111/eje.13144

Vancouver

Babaee Hemmati Y, Rasouli M, Falahchai M. Comparative Analysis of ChatGPT ‐3.5 and GPT ‐4 in Open‐Ended Clinical Reasoning Across Dental Specialties. European Journal of Dental Education. 2026;30(2):526-532. doi:10.1111/eje.13144

BibTeX
@article{BabaeeHemmati2026,
  author = {Babaee Hemmati, Yasamin and Rasouli, Morteza and Falahchai, Mehran},
  title = {Comparative Analysis of ChatGPT ‐3.5 and GPT ‐4 in Open‐Ended Clinical Reasoning Across Dental Specialties},
  journal = {European Journal of Dental Education},
  year = {2026},
  volume = {30},
  number = {2},
  pages = {526--532},
  doi = {10.1111/eje.13144}
}
Kostenlos starten →