EUVIMEDAtrasti EUVIMED
Open access · CC BY-NC-ND 4.0

Performance of artificial intelligence chatbots in responding to the frequently asked questions of patients regarding dental prostheses

Hossein Esmailpour, Vanya Rasaie, Yasamin Babaee Hemmati, Mehran Falahchai

BMC Oral Health · 2025-04-15 · 25 (1)

DOI: 10.1186/s12903-025-05965-9 ↗

At a glance

Journal article in BMC Oral Health, published online on 2025-04-15. Written by Hossein Esmailpour and 3 co-authors. Institution: School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran. Major MEDLINE topics: Artificial Intelligence, Dental Prosthesis. Cited 42 times so far (Crossref); 57 references. The full text is freely available (open access, CC BY-NC-ND 4.0). Funded by: Guilan University of Medical Sciences.

SantraukaSubjectsBibliografiniai duomenysCiteRelated studies

Abstract (original language)

BACKGROUND: Artificial intelligence (AI) chatbots are increasingly used in healthcare to address patient questions by providing personalized responses. Evaluating their performance is essential to ensure their reliability. This study aimed to assess the performance of three AI chatbots in responding to the frequently asked questions (FAQs) of patients regarding dental prostheses. METHODS: Thirty-one frequently asked questions (FAQs) were collected from accredited organizations' websites and the "People Also Ask" feature of Google, focusing on removable and fixed prosthodontics. Two board-certified prosthodontists evaluated response quality using the modified Global Quality Score (GQS) on a 5-point Likert scale. Inter-examiner agreement was assessed using weighted kappa. Readability was measured using the Flesch-Kincaid Grade Level (FKGL) and Flesch Reading Ease (FRE) indices. Statistical analyses were performed using repeated measures ANOVA and Friedman test, with Bonferroni correction for pairwise comparisons (α = 0.05). RESULTS: The inter-examiner agreement was good. Among the chatbots, Google Gemini had the highest quality score (4.58 ± 0.50), significantly outperforming Microsoft Copilot (3.87 ± 0.89) (P =.004). Readability analysis showed ChatGPT (10.45 ± 1.26) produced significantly more complex responses compared to Gemini (7.82 ± 1.19) and Copilot (8.38 ± 1.59) (P

Subjects

MeSH terms (MEDLINE)

Artificial IntelligenceDental ProsthesisHumansComprehensionGenerative Artificial Intelligence

Author keywords

Artificial intelligenceHealth literacyNatural Language processingPatient education as topicProsthodontics

Authors and institutions

  • School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran.
  • Research Affiliate at Sydney Dental School, Faculty of Medicine and Health, Sydney, Australia.
  • Department of Orthodontics, Dental Sciences Research Center, School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran.
  • Department of Prosthodontics, Dental Sciences Research Center, School of Dentistry, Guilan University of Medical Sciences, Rasht, Iran. Mehran.falahchai@gmail.com.

Funding

  • Guilan University of Medical Sciences

Cite

APA

Esmailpour, H., Rasaie, V., Babaee Hemmati, Y., & Falahchai, M. (2025). Performance of artificial intelligence chatbots in responding to the frequently asked questions of patients regarding dental prostheses. BMC Oral Health, 25(1). https://doi.org/10.1186/s12903-025-05965-9

Vancouver

Esmailpour H, Rasaie V, Babaee Hemmati Y, Falahchai M. Performance of artificial intelligence chatbots in responding to the frequently asked questions of patients regarding dental prostheses. BMC Oral Health. 2025;25(1). doi:10.1186/s12903-025-05965-9

BibTeX
@article{Esmailpour2025,
  author = {Esmailpour, Hossein and Rasaie, Vanya and Babaee Hemmati, Yasamin and Falahchai, Mehran},
  title = {Performance of artificial intelligence chatbots in responding to the frequently asked questions of patients regarding dental prostheses},
  journal = {BMC Oral Health},
  year = {2025},
  volume = {25},
  number = {1},
  doi = {10.1186/s12903-025-05965-9}
}
Start for free →