EUVIMEDEUVIMED entdecken
Crossref

Assessment of the Accuracy of Modern Artificial Intelligence Chatbots in Responding to Endodontic Queries

Melis Çakar iD, Ayşe Tuğba Eminsoy Avcı, Salih Düzgün iD, Tuğrul Aslan, Kübra Nur Hekimoğlu

Australian Endodontic Journal · 2025-12 · 51 (3) · 732-739

DOI: 10.1111/aej.70012 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Australian Endodontic Journal, online erschienen am 20.08.2025. Verfasst von Melis Çakar und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Endodontics, Faculty of Dentistry, Erciyes University, Kayseri, Türkiye. Hauptthemen laut MEDLINE: Artificial Intelligence, Endodontics. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 33 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study aims to compare the accuracy of modern AI chatbots, including Gemini 1.5 Flash, Gemini 1.5 Pro, ChatGPT‐3.5 and ChatGPT‐4, in responding to endodontic questions and supporting clinicians. Forty yes/no questions covering 12 endodontic topics were formulated by three experts. Each question was presented to the AI models on the same day, with a new chat session initiated for each. The agreement between chatbot responses and expert consensus was assessed using Cohen's kappa test ( p < 0.05). ChatGPT‐3.5 demonstrated the highest accuracy (80%), followed by ChatGPT‐4 (77.5%), Gemini 1.5 Pro (72.5%) and Gemini 1.5 Flash (60%). The agreement levels ranged from weak (ChatGPT models) to minimal (Gemini Flash). The findings indicate variability in chatbot performance, with ChatGPT models outperforming Gemini. However, reliance on AI‐generated responses for clinical decision‐making remains questionable. Future studies should incorporate more complex clinical scenarios and broader analytical approaches to enhance the assessment of AI chatbots in endodontics.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceEndodonticsHumansGenerative Artificial Intelligence

Stichwörter der Autor:innen

ChatGPTGeminiclinical decision‐makingdiagnostic accuracylarge language models

Autor:innen und Institutionen

  • Department of Endodontics, Faculty of Dentistry, Erciyes University, Kayseri, Türkiye.

ORCID-Profile: Melis Çakar, Salih Düzgün

Zitieren

APA

Çakar, M., Avcı, A. T. E., Düzgün, S., Aslan, T., & Hekimoğlu, K. N. (2025). Assessment of the Accuracy of Modern Artificial Intelligence Chatbots in Responding to Endodontic Queries. Australian Endodontic Journal, 51(3), 732-739. https://doi.org/10.1111/aej.70012

Vancouver

Çakar M, Avcı ATE, Düzgün S, Aslan T, Hekimoğlu KN. Assessment of the Accuracy of Modern Artificial Intelligence Chatbots in Responding to Endodontic Queries. Australian Endodontic Journal. 2025;51(3):732-739. doi:10.1111/aej.70012

BibTeX
@article{akar2025,
  author = {Çakar, Melis and Avcı, Ayşe Tuğba Eminsoy and Düzgün, Salih and Aslan, Tuğrul and Hekimoğlu, Kübra Nur},
  title = {Assessment of the Accuracy of Modern Artificial Intelligence Chatbots in Responding to Endodontic Queries},
  journal = {Australian Endodontic Journal},
  year = {2025},
  volume = {51},
  number = {3},
  pages = {732--739},
  doi = {10.1111/aej.70012}
}
Kostenlos starten →