EUVIMEDEUVIMED entdecken
Crossref

Performance of ChatGPT‐3.5 and ChatGPT‐4o in the Japanese National Dental Examination

Osamu Uehara iD, Tetsuro Morikawa, Fumiya Harada, Nodoka Sugiyama, Yuko Matsuki, Daichi Hiraki, Hinako Sakurai, Takashi Kado, Koki Yoshida, Yukie Murata, Hirofumi Matsuoka, Toshiyuki Nagasawa und 3 weitere

Journal of Dental Education · 2025

DOI: 10.1002/jdd.13766 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Dental Education, 2025. Verfasst von Osamu Uehara und 14 weiteren Autor:innen. Beteiligte Einrichtung: Division of Disease Control and Molecular Epidemiology, Department of Oral Growth and Development, School of Dentistry, Health Sciences University of…. Hauptthemen laut MEDLINE: Clinical Competence, Education, Dental, Educational Measurement. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 11 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objectives

In this study, we compared the performance of ChatGPT‐3.5 to that of ChatGPT‐4o in the context of the Japanese National Dental Examination, which assesses clinical reasoning skills and dental knowledge, to determine their potential usefulness in dental education.

Methods

ChatGPT's performance was assessed using 1399 (55% of the exam) of 2520 questions from the Japanese National Dental Examinations (111−117). The 1121 excluded questions (45% of the exam) contained figures or tables that ChatGPT could not recognize. The questions were categorized into 18 different subjects based on dental specialty. Statistical analysis was performed using SPSS software, with McNemar's test applied to assess differences in performance.

Results

A significant improvement was noted in the percentage of correct answers from ChatGPT‐4o (84.63%) compared with those from ChatGPT‐3.5 (45.46%), demonstrating enhanced reliability and subject knowledge. ChatGPT‐4o consistently outperformed ChatGPT‐3.5 across all dental subjects, with significant improvements in subjects such as oral surgery, pathology, pharmacology, and microbiology. Heatmap analysis revealed that ChatGPT‐4o provided more stable and higher correct answer rates, especially for complex subjects.

Conclusions

This study found that advanced natural language processing models, such as ChatGPT‐4o, potentially have sufficiently advanced clinical reasoning skills and dental knowledge to function as a supplementary tool in dental education and exam preparation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Clinical CompetenceEducation, DentalEducational MeasurementHumansGenerative Artificial IntelligenceJapan

Stichwörter der Autor:innen

Chat Generative Pre‐trained Transformer (ChatGPT)Japanese National Dental Examinationartificial intelligencedental educationnatural language processing

Autor:innen und Institutionen

  • Division of Disease Control and Molecular Epidemiology, Department of Oral Growth and Development, School of Dentistry, Health Sciences University of Hokkaido, Ishikari-gun, Hokkaido, Japan.
  • Division of Oral Medicine and Pathology, Department of Human Biology and Pathophysiology, School of Dentistry, Health Sciences University of Hokkaido, Ishikari-gun, Hokkaido, Japan.
  • Division of Oral and Maxillofacial Surgery, Department of Human Biology and Pathophysiology, School of Dentistry, Health Sciences University of Hokkaido, Ishikari-gun, Hokkaido, Japan.
  • Division of Periodontology and Endodontology, Department of Oral Rehabilitation, School of Dentistry, Health Sciences University of Hokkaido, Ishikari-gun, Hokkaido, Japan.
  • Division of Advanced Clinical Education, Department of Integrated Dental Education, School of Dentistry, Health Sciences University of Hokkaido, Ishikari-gun, Hokkaido, Japan.
  • Division of Reconstructive Surgery for Oral and Maxillofacial Region, Department of Human Biology and Pathophysiology, School of Dentistry, Health Sciences University of Hokkaido, Ishikari-gun, Hokkaido, Japan.

ORCID-Profile: Osamu Uehara

Zitieren

APA

Uehara, O., Morikawa, T., Harada, F., Sugiyama, N., Matsuki, Y., Hiraki, D., Sakurai, H., Kado, T., Yoshida, K., Murata, Y., Matsuoka, H., Nagasawa, T., Furuichi, Y., Abiko, Y., & Miura, H. (2025). Performance of ChatGPT‐3.5 and ChatGPT‐4o in the Japanese National Dental Examination. Journal of Dental Education. https://doi.org/10.1002/jdd.13766

Vancouver

Uehara O, Morikawa T, Harada F, Sugiyama N, Matsuki Y, Hiraki D, et al. Performance of ChatGPT‐3.5 and ChatGPT‐4o in the Japanese National Dental Examination. Journal of Dental Education. 2025. doi:10.1002/jdd.13766

BibTeX
@article{Uehara2025,
  author = {Uehara, Osamu and Morikawa, Tetsuro and Harada, Fumiya and Sugiyama, Nodoka and Matsuki, Yuko and Hiraki, Daichi and Sakurai, Hinako and Kado, Takashi and Yoshida, Koki and Murata, Yukie and Matsuoka, Hirofumi and Nagasawa, Toshiyuki and Furuichi, Yasushi and Abiko, Yoshihiro and Miura, Hiroko},
  title = {Performance of ChatGPT‐3.5 and ChatGPT‐4o in the Japanese National Dental Examination},
  journal = {Journal of Dental Education},
  year = {2025},
  doi = {10.1002/jdd.13766}
}
Kostenlos starten →