EUVIMEDEUVIMED entdecken
Open Access

Accuracy, Self-Reported Confidence, and Overconfidence of Large Language Models in Endodontics: An Evaluation Using National Specialty Examination Questions

Mehmet Adıgüzel

Medical Science Monitor · 2026

DOI: 10.12659/msm.954052 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Medical Science Monitor, 2026. Verfasst von Mehmet Adıgüzel. Beteiligte Einrichtung: Department of Endodontics, Faculty of Dentistry, Hatay Mustafa Kemal University, Hatay, Turkey. Hauptthemen laut MEDLINE: Endodontics, Educational Measurement. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

BACKGROUND This study aimed to evaluate the accuracy, confidence, and overconfidence behavior of large language models (LLMs) in endodontics using questions derived from a national specialty entrance examination. MATERIAL AND METHODS A total of 123 text-based endodontic questions from the Turkish Dental Specialty Examination (2017-2026) were included after excluding annulled and image-based questions. Three LLMs (ChatGPT, Claude, and Gemini) were assessed. Each model answered all questions using a standardized prompt and provided a confidence score (0%-100%). Accuracy was recorded as correct/incorrect. Overconfidence was defined as incorrect responses with ≥90% confidence. Statistical analyses were performed using Cochran's Q test, Friedman test, and post hoc pairwise comparisons with Bonferroni correction. RESULTS Accuracy rates were 89.4% for ChatGPT, 76.4% for Claude, and 90.2% for Gemini, with significant differences among models (χ²(2)=21.00, P

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EndodonticsEducational MeasurementLarge Language ModelsHumansTurkeyClinical CompetenceSurveys and Questionnaires

Autor:innen und Institutionen

  • Department of Endodontics, Faculty of Dentistry, Hatay Mustafa Kemal University, Hatay, Turkey.

Zitieren

APA

Adıgüzel, M. (2026). Accuracy, Self-Reported Confidence, and Overconfidence of Large Language Models in Endodontics: An Evaluation Using National Specialty Examination Questions. Medical Science Monitor. https://doi.org/10.12659/msm.954052

Vancouver

Adıgüzel M. Accuracy, Self-Reported Confidence, and Overconfidence of Large Language Models in Endodontics: An Evaluation Using National Specialty Examination Questions. Medical Science Monitor. 2026. doi:10.12659/msm.954052

BibTeX
@article{Adgzel2026,
  author = {Adıgüzel, Mehmet},
  title = {Accuracy, Self-Reported Confidence, and Overconfidence of Large Language Models in Endodontics: An Evaluation Using National Specialty Examination Questions},
  journal = {Medical Science Monitor},
  year = {2026},
  doi = {10.12659/msm.954052}
}
Kostenlos starten →