EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluating the validity and consistency of artificial intelligence chatbots in responding to patients’ frequently asked questions in prosthodontics

Maryam Gheisarifar, Marwa Shembesh, Merve Koseoglu, Qiao Fang, Fatemeh Solmaz Afshari, Judy Chia-Chun Yuan, Cortino Sukotjo

The Journal of Prosthetic Dentistry · 2025-07 · 134 (1) · 199-206

DOI: 10.1016/j.prosdent.2025.03.009 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of Prosthetic Dentistry, 2025-07. Verfasst von Maryam Gheisarifar und 6 weiteren Autor:innen. Beteiligte Einrichtung: Clinical Assistant Professor, Department of Restorative Dentistry, College of Dentistry, University of Illinois Chicago, Chicago, Ill. Hauptthemen laut MEDLINE: Artificial Intelligence, Prosthodontics. Die Arbeit wurde bisher 42-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

STATEMENT OF PROBLEM: Healthcare-related information provided by artificial intelligence (AI) chatbots may pose challenges such as inaccuracies, lack of empathy, biases, over-reliance, limited scope, and ethical concerns. PURPOSE: The purpose of this study was to evaluate and compare the validity and consistency of responses to prosthodontics-related frequently asked questions (FAQ) generated by 4 different chatbot systems. MATERIAL AND METHODS: Four prosthodontics domains were evaluated: implant, fixed prosthodontics, complete denture (CD), and removable partial denture (RPD). Within each domain, 10 questions were prepared by full-time prosthodontic faculty members, and 10 questions were generated by GPT-3.5, representing its top frequently asked questions in each domain. The validity and consistency of responses provided by 4 chatbots: GPT-3.5, GPT-4, Gemini, and Bing were evaluated. The chi-squared test with the Yates correction was used to compare the validity of responses between different chatbots (α=.05). The Cronbach alpha was calculated for 3 sets of responses collected in the morning, afternoon, and evening to evaluate the consistency of the responses. RESULTS: According to the low threshold validity test, the chatbots' answers to ChatGPT's implant-related, ChatGPT's RPD-related, and prosthodontists' CD-related FAQs were statistically different (P

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceProsthodonticsHumansSurveys and QuestionnairesReproducibility of ResultsDenture, Partial, RemovableGenerative Artificial Intelligence

Autor:innen und Institutionen

  • Clinical Assistant Professor, Department of Restorative Dentistry, College of Dentistry, University of Illinois Chicago, Chicago, Ill.
  • Associate Professor, Department of Prosthodontics, Faculty of Dentistry, University of Sakarya, Sakarya, Turkey; and PhD student, Department of Prosthodontics, Faculty of Dentistry, University of Ataturk, Erzurum, Turke…
  • Associate Professor, Department of Restorative Dentistry, College of Dentistry, University of Illinois Chicago, Chicago, Ill.
  • Professor and Associate Dean for Clinical Affairs, Department of Restorative Dentistry, College of Dentistry, University of Illinois Chicago, Chicago, Ill.
  • Professor and Chair, Department of Prosthodontics, University of Pittsburgh, School of Dental Medicine, Pittsburgh, PA. Electronic address: Cos162@pitt.edu.

Zitieren

APA

Gheisarifar, M., Shembesh, M., Koseoglu, M., Fang, Q., Afshari, F. S., Yuan, J. C., & Sukotjo, C. (2025). Evaluating the validity and consistency of artificial intelligence chatbots in responding to patients’ frequently asked questions in prosthodontics. The Journal of Prosthetic Dentistry, 134(1), 199-206. https://doi.org/10.1016/j.prosdent.2025.03.009

Vancouver

Gheisarifar M, Shembesh M, Koseoglu M, Fang Q, Afshari FS, Yuan JC, et al. Evaluating the validity and consistency of artificial intelligence chatbots in responding to patients’ frequently asked questions in prosthodontics. The Journal of Prosthetic Dentistry. 2025;134(1):199-206. doi:10.1016/j.prosdent.2025.03.009

BibTeX
@article{Gheisarifar2025,
  author = {Gheisarifar, Maryam and Shembesh, Marwa and Koseoglu, Merve and Fang, Qiao and Afshari, Fatemeh Solmaz and Yuan, Judy Chia-Chun and Sukotjo, Cortino},
  title = {Evaluating the validity and consistency of artificial intelligence chatbots in responding to patients’ frequently asked questions in prosthodontics},
  journal = {The Journal of Prosthetic Dentistry},
  year = {2025},
  volume = {134},
  number = {1},
  pages = {199--206},
  doi = {10.1016/j.prosdent.2025.03.009}
}
Kostenlos starten →