Performance of artificial intelligence chatbots in responding to the frequently asked questions of patients regarding dental prostheses
BMC Oral Health · 2025-04-15 · 25 (1)
DOI: 10.1186/s12903-025-05965-9 ↗At a glance
Journal article in BMC Oral Health, published online on 2025-04-15. Written by Hossein Esmailpour and 3 co-authors. Institution: School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran. Major MEDLINE topics: Artificial Intelligence, Dental Prosthesis. Cited 42 times so far (Crossref); 57 references. The full text is freely available (open access, CC BY-NC-ND 4.0). Funded by: Guilan University of Medical Sciences.
Abstract (original language)
BACKGROUND: Artificial intelligence (AI) chatbots are increasingly used in healthcare to address patient questions by providing personalized responses. Evaluating their performance is essential to ensure their reliability. This study aimed to assess the performance of three AI chatbots in responding to the frequently asked questions (FAQs) of patients regarding dental prostheses. METHODS: Thirty-one frequently asked questions (FAQs) were collected from accredited organizations' websites and the "People Also Ask" feature of Google, focusing on removable and fixed prosthodontics. Two board-certified prosthodontists evaluated response quality using the modified Global Quality Score (GQS) on a 5-point Likert scale. Inter-examiner agreement was assessed using weighted kappa. Readability was measured using the Flesch-Kincaid Grade Level (FKGL) and Flesch Reading Ease (FRE) indices. Statistical analyses were performed using repeated measures ANOVA and Friedman test, with Bonferroni correction for pairwise comparisons (α = 0.05). RESULTS: The inter-examiner agreement was good. Among the chatbots, Google Gemini had the highest quality score (4.58 ± 0.50), significantly outperforming Microsoft Copilot (3.87 ± 0.89) (P =.004). Readability analysis showed ChatGPT (10.45 ± 1.26) produced significantly more complex responses compared to Gemini (7.82 ± 1.19) and Copilot (8.38 ± 1.59) (P
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran.
- Research Affiliate at Sydney Dental School, Faculty of Medicine and Health, Sydney, Australia.
- Department of Orthodontics, Dental Sciences Research Center, School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran.
- Department of Prosthodontics, Dental Sciences Research Center, School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran. Mehran.falahchai@gmail.com.
Funding
- Guilan University of Medical Sciences
Cite
APA
Esmailpour, H., Rasaie, V., Babaee Hemmati, Y., & Falahchai, M. (2025). Performance of artificial intelligence chatbots in responding to the frequently asked questions of patients regarding dental prostheses. BMC Oral Health, 25(1). https://doi.org/10.1186/s12903-025-05965-9
Vancouver
Esmailpour H, Rasaie V, Babaee Hemmati Y, Falahchai M. Performance of artificial intelligence chatbots in responding to the frequently asked questions of patients regarding dental prostheses. BMC Oral Health. 2025;25(1). doi:10.1186/s12903-025-05965-9
BibTeX
@article{Esmailpour2025,
author = {Esmailpour, Hossein and Rasaie, Vanya and Babaee Hemmati, Yasamin and Falahchai, Mehran},
title = {Performance of artificial intelligence chatbots in responding to the frequently asked questions of patients regarding dental prostheses},
journal = {BMC Oral Health},
year = {2025},
volume = {25},
number = {1},
doi = {10.1186/s12903-025-05965-9}
}
EUVIMED