EUVIMEDOpdag EUVIMED
VergleichsstudieEvaluationsstudieOpen access

Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality

Vasfiye Isik iD, Rana Ikbal Sengul iD, Soner Sismanoglu iD

Australian Endodontic Journal · 2026-08 · 52 (2) · 356-363

DOI: 10.1111/aej.70055 ↗

At a glance

Vergleichsstudie in Australian Endodontic Journal, published online on 2026-01-08. Written by Vasfiye Isik and 2 co-authors. Institution: Department of Endodontics, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey. Major MEDLINE topics: Tooth Injuries, Large Language Models. Cited 7 times so far (Crossref); 25 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

This study evaluated and compared the accuracy, consistency, readability, and information quality of three LLM‐based chatbots, namely ChatGPT‐5, Claude AI (Sonnet 4.0), and Perplexity (Mistral Large 2), in addressing traumatic dental injury questions. Forty true/false statements were submitted to each chatbot three times at weekly intervals to assess accuracy and consistency. Additionally, chatbot responses for 25 open‐ended case‐based questions were evaluated for readability, understandability and actionability, information reliability and quality. For true/false questions, Perplexity showed the highest accuracy, followed by Claude and ChatGPT. For open‐ended responses, ChatGPT excelled in readability (FRE: 62.4 ± 7.6), Perplexity in understandability (91.0 ± 4.3) and actionability (93.0 ± 6.4) and Claude in information reliability (mDISCERN total: 61.2; no variability observed). All chatbots achieved acceptable global quality scores (> 4.4). These findings emphasise the complementary role of chatbots in dental trauma management. Tool selection should be based on intended use, while continued human oversight remains essential in clinical decision‐making.

Subjects

MeSH terms (MEDLINE)

Tooth InjuriesLarge Language ModelsHumansReproducibility of ResultsComprehension

Author keywords

artificial intelligencechatbotsdental traumalarge language modelstraumatic dental injuries

Authors and institutions

  • Department of Endodontics, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey.
  • Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey.
  • Department of Restorative Dentistry, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey.

ORCID profiles: Vasfiye Isik, Rana Ikbal Sengul, Soner Sismanoglu

Cite

APA

Isik, V., Sengul, R. I., & Sismanoglu, S. (2026). Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality. Australian Endodontic Journal, 52(2), 356-363. https://doi.org/10.1111/aej.70055

Vancouver

Isik V, Sengul RI, Sismanoglu S. Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality. Australian Endodontic Journal. 2026;52(2):356-363. doi:10.1111/aej.70055

BibTeX
@article{Isik2026,
  author = {Isik, Vasfiye and Sengul, Rana Ikbal and Sismanoglu, Soner},
  title = {Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality},
  journal = {Australian Endodontic Journal},
  year = {2026},
  volume = {52},
  number = {2},
  pages = {356--363},
  doi = {10.1111/aej.70055}
}
Start for free →