Accuracy, Self-Reported Confidence, and Overconfidence of Large Language Models in Endodontics: An Evaluation Using National Specialty Examination Questions
Medical Science Monitor · 2026
DOI: 10.12659/msm.954052 ↗Kurz gefasst
Fachartikel in der Zeitschrift Medical Science Monitor, 2026. Verfasst von Mehmet Adıgüzel. Beteiligte Einrichtung: Department of Endodontics, Faculty of Dentistry, Hatay Mustafa Kemal University, Hatay, Turkey. Hauptthemen laut MEDLINE: Endodontics, Educational Measurement. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
BACKGROUND This study aimed to evaluate the accuracy, confidence, and overconfidence behavior of large language models (LLMs) in endodontics using questions derived from a national specialty entrance examination. MATERIAL AND METHODS A total of 123 text-based endodontic questions from the Turkish Dental Specialty Examination (2017-2026) were included after excluding annulled and image-based questions. Three LLMs (ChatGPT, Claude, and Gemini) were assessed. Each model answered all questions using a standardized prompt and provided a confidence score (0%-100%). Accuracy was recorded as correct/incorrect. Overconfidence was defined as incorrect responses with ≥90% confidence. Statistical analyses were performed using Cochran's Q test, Friedman test, and post hoc pairwise comparisons with Bonferroni correction. RESULTS Accuracy rates were 89.4% for ChatGPT, 76.4% for Claude, and 90.2% for Gemini, with significant differences among models (χ²(2)=21.00, P
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Endodontics, Faculty of Dentistry, Hatay Mustafa Kemal University, Hatay, Turkey.
Zitieren
APA
Adıgüzel, M. (2026). Accuracy, Self-Reported Confidence, and Overconfidence of Large Language Models in Endodontics: An Evaluation Using National Specialty Examination Questions. Medical Science Monitor. https://doi.org/10.12659/msm.954052
Vancouver
Adıgüzel M. Accuracy, Self-Reported Confidence, and Overconfidence of Large Language Models in Endodontics: An Evaluation Using National Specialty Examination Questions. Medical Science Monitor. 2026. doi:10.12659/msm.954052
BibTeX
@article{Adgzel2026,
author = {Adıgüzel, Mehmet},
title = {Accuracy, Self-Reported Confidence, and Overconfidence of Large Language Models in Endodontics: An Evaluation Using National Specialty Examination Questions},
journal = {Medical Science Monitor},
year = {2026},
doi = {10.12659/msm.954052}
}
EUVIMED