EUVIMEDEUVIMED entdecken
VergleichsstudieEvaluationsstudieOpen Access

Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality

Vasfiye Isik iD, Rana Ikbal Sengul iD, Soner Sismanoglu iD

Australian Endodontic Journal · 2026-08 · 52 (2) · 356-363

DOI: 10.1111/aej.70055 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Australian Endodontic Journal, online erschienen am 08.01.2026. Verfasst von Vasfiye Isik und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Endodontics, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey. Hauptthemen laut MEDLINE: Tooth Injuries, Large Language Models. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study evaluated and compared the accuracy, consistency, readability, and information quality of three LLM‐based chatbots, namely ChatGPT‐5, Claude AI (Sonnet 4.0), and Perplexity (Mistral Large 2), in addressing traumatic dental injury questions. Forty true/false statements were submitted to each chatbot three times at weekly intervals to assess accuracy and consistency. Additionally, chatbot responses for 25 open‐ended case‐based questions were evaluated for readability, understandability and actionability, information reliability and quality. For true/false questions, Perplexity showed the highest accuracy, followed by Claude and ChatGPT. For open‐ended responses, ChatGPT excelled in readability (FRE: 62.4 ± 7.6), Perplexity in understandability (91.0 ± 4.3) and actionability (93.0 ± 6.4) and Claude in information reliability (mDISCERN total: 61.2; no variability observed). All chatbots achieved acceptable global quality scores (> 4.4). These findings emphasise the complementary role of chatbots in dental trauma management. Tool selection should be based on intended use, while continued human oversight remains essential in clinical decision‐making.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Tooth InjuriesLarge Language ModelsHumansReproducibility of ResultsComprehension

Stichwörter der Autor:innen

artificial intelligencechatbotsdental traumalarge language modelstraumatic dental injuries

Autor:innen und Institutionen

  • Department of Endodontics, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey.
  • Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey.
  • Department of Restorative Dentistry, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey.

ORCID-Profile: Vasfiye Isik, Rana Ikbal Sengul, Soner Sismanoglu

Zitieren

APA

Isik, V., Sengul, R. I., & Sismanoglu, S. (2026). Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality. Australian Endodontic Journal, 52(2), 356-363. https://doi.org/10.1111/aej.70055

Vancouver

Isik V, Sengul RI, Sismanoglu S. Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality. Australian Endodontic Journal. 2026;52(2):356-363. doi:10.1111/aej.70055

BibTeX
@article{Isik2026,
  author = {Isik, Vasfiye and Sengul, Rana Ikbal and Sismanoglu, Soner},
  title = {Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality},
  journal = {Australian Endodontic Journal},
  year = {2026},
  volume = {52},
  number = {2},
  pages = {356--363},
  doi = {10.1111/aej.70055}
}
Kostenlos starten →