Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality
Australian Endodontic Journal · 2026-08 · 52 (2) · 356-363
DOI: 10.1111/aej.70055 ↗At a glance
Vergleichsstudie in Australian Endodontic Journal, published online on 2026-01-08. Written by Vasfiye Isik and 2 co-authors. Institution: Department of Endodontics, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey. Major MEDLINE topics: Tooth Injuries, Large Language Models. Cited 7 times so far (Crossref); 25 references. The full text is freely available in PubMed Central.
Abstract (original language)
This study evaluated and compared the accuracy, consistency, readability, and information quality of three LLM‐based chatbots, namely ChatGPT‐5, Claude AI (Sonnet 4.0), and Perplexity (Mistral Large 2), in addressing traumatic dental injury questions. Forty true/false statements were submitted to each chatbot three times at weekly intervals to assess accuracy and consistency. Additionally, chatbot responses for 25 open‐ended case‐based questions were evaluated for readability, understandability and actionability, information reliability and quality. For true/false questions, Perplexity showed the highest accuracy, followed by Claude and ChatGPT. For open‐ended responses, ChatGPT excelled in readability (FRE: 62.4 ± 7.6), Perplexity in understandability (91.0 ± 4.3) and actionability (93.0 ± 6.4) and Claude in information reliability (mDISCERN total: 61.2; no variability observed). All chatbots achieved acceptable global quality scores (> 4.4). These findings emphasise the complementary role of chatbots in dental trauma management. Tool selection should be based on intended use, while continued human oversight remains essential in clinical decision‐making.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Endodontics, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey.
- Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey.
- Department of Restorative Dentistry, Faculty of Dentistry, Istanbul University-Cerrahpaşa, Istanbul, Turkey.
ORCID profiles: Vasfiye Isik, Rana Ikbal Sengul, Soner Sismanoglu
Cite
APA
Isik, V., Sengul, R. I., & Sismanoglu, S. (2026). Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality. Australian Endodontic Journal, 52(2), 356-363. https://doi.org/10.1111/aej.70055
Vancouver
Isik V, Sengul RI, Sismanoglu S. Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality. Australian Endodontic Journal. 2026;52(2):356-363. doi:10.1111/aej.70055
BibTeX
@article{Isik2026,
author = {Isik, Vasfiye and Sengul, Rana Ikbal and Sismanoglu, Soner},
title = {Evaluation of Large Language Model‐Based Chatbots for Dental Trauma Management: A Comparative Study Based on Accuracy, Consistency and Information Quality},
journal = {Australian Endodontic Journal},
year = {2026},
volume = {52},
number = {2},
pages = {356--363},
doi = {10.1111/aej.70055}
}
EUVIMED