Performance of ChatGPT‐3.5 and ChatGPT‐4o in the Japanese National Dental Examination
Journal of Dental Education · 2025
DOI: 10.1002/jdd.13766 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Dental Education, 2025. Verfasst von Osamu Uehara und 14 weiteren Autor:innen. Beteiligte Einrichtung: Division of Disease Control and Molecular Epidemiology, Department of Oral Growth and Development, School of Dentistry, Health Sciences University of…. Hauptthemen laut MEDLINE: Clinical Competence, Education, Dental, Educational Measurement. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 11 Literaturangaben.
Abstract (Originalsprache)
Objectives
In this study, we compared the performance of ChatGPT‐3.5 to that of ChatGPT‐4o in the context of the Japanese National Dental Examination, which assesses clinical reasoning skills and dental knowledge, to determine their potential usefulness in dental education.
Methods
ChatGPT's performance was assessed using 1399 (55% of the exam) of 2520 questions from the Japanese National Dental Examinations (111−117). The 1121 excluded questions (45% of the exam) contained figures or tables that ChatGPT could not recognize. The questions were categorized into 18 different subjects based on dental specialty. Statistical analysis was performed using SPSS software, with McNemar's test applied to assess differences in performance.
Results
A significant improvement was noted in the percentage of correct answers from ChatGPT‐4o (84.63%) compared with those from ChatGPT‐3.5 (45.46%), demonstrating enhanced reliability and subject knowledge. ChatGPT‐4o consistently outperformed ChatGPT‐3.5 across all dental subjects, with significant improvements in subjects such as oral surgery, pathology, pharmacology, and microbiology. Heatmap analysis revealed that ChatGPT‐4o provided more stable and higher correct answer rates, especially for complex subjects.
Conclusions
This study found that advanced natural language processing models, such as ChatGPT‐4o, potentially have sufficiently advanced clinical reasoning skills and dental knowledge to function as a supplementary tool in dental education and exam preparation.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Disease Control and Molecular Epidemiology, Department of Oral Growth and Development, School of Dentistry, Health Sciences University of Hokkaido, Ishikari-gun, Hokkaido, Japan.
- Division of Oral Medicine and Pathology, Department of Human Biology and Pathophysiology, School of Dentistry, Health Sciences University of Hokkaido, Ishikari-gun, Hokkaido, Japan.
- Division of Oral and Maxillofacial Surgery, Department of Human Biology and Pathophysiology, School of Dentistry, Health Sciences University of Hokkaido, Ishikari-gun, Hokkaido, Japan.
- Division of Periodontology and Endodontology, Department of Oral Rehabilitation, School of Dentistry, Health Sciences University of Hokkaido, Ishikari-gun, Hokkaido, Japan.
- Division of Advanced Clinical Education, Department of Integrated Dental Education, School of Dentistry, Health Sciences University of Hokkaido, Ishikari-gun, Hokkaido, Japan.
- Division of Reconstructive Surgery for Oral and Maxillofacial Region, Department of Human Biology and Pathophysiology, School of Dentistry, Health Sciences University of Hokkaido, Ishikari-gun, Hokkaido, Japan.
ORCID-Profile: Osamu Uehara
Zitieren
APA
Uehara, O., Morikawa, T., Harada, F., Sugiyama, N., Matsuki, Y., Hiraki, D., Sakurai, H., Kado, T., Yoshida, K., Murata, Y., Matsuoka, H., Nagasawa, T., Furuichi, Y., Abiko, Y., & Miura, H. (2025). Performance of ChatGPT‐3.5 and ChatGPT‐4o in the Japanese National Dental Examination. Journal of Dental Education. https://doi.org/10.1002/jdd.13766
Vancouver
Uehara O, Morikawa T, Harada F, Sugiyama N, Matsuki Y, Hiraki D, et al. Performance of ChatGPT‐3.5 and ChatGPT‐4o in the Japanese National Dental Examination. Journal of Dental Education. 2025. doi:10.1002/jdd.13766
BibTeX
@article{Uehara2025,
author = {Uehara, Osamu and Morikawa, Tetsuro and Harada, Fumiya and Sugiyama, Nodoka and Matsuki, Yuko and Hiraki, Daichi and Sakurai, Hinako and Kado, Takashi and Yoshida, Koki and Murata, Yukie and Matsuoka, Hirofumi and Nagasawa, Toshiyuki and Furuichi, Yasushi and Abiko, Yoshihiro and Miura, Hiroko},
title = {Performance of ChatGPT‐3.5 and ChatGPT‐4o in the Japanese National Dental Examination},
journal = {Journal of Dental Education},
year = {2025},
doi = {10.1002/jdd.13766}
}
EUVIMED