EUVIMEDEUVIMED entdecken
Crossref

Efficacy and empathy of AI chatbots in answering frequently asked questions on oral oncology

Rata Rokhshad, Zaid H Khoury, Hossein Mohammad-Rahimi, Parisa Motie, Jeffery B Price, Tiffany Tavares, Maryam Jessri, Roxanne Bavarian, James J Sciubba, Ahmed S Sultan

Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology · 2025-06 · 139 (6) · 719-728

DOI: 10.1016/j.oooo.2024.12.028 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology, 2025-06. Verfasst von Rata Rokhshad und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Pediatric Dentistry, Loma Linda School of Dentistry, CA, USA. Hauptthemen laut MEDLINE: Mouth Neoplasms, Empathy, Artificial Intelligence, Social Media. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 33 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

OBJECTIVES: Artificial intelligence chatbots have demonstrated feasibility and efficacy in improving health outcomes. In this study, responses from 5 different publicly available AI chatbots-Bing, GPT-3.5, GPT-4, Google Bard, and Claude-to frequently asked questions related to oral cancer were evaluated. STUDY DESIGN: Relevant patient-related frequently asked questions about oral cancer were obtained from two main sources: public health websites and social media platforms. From these sources, 20 oral cancer-related questions were selected. Four board-certified specialists in oral medicine/oral and maxillofacial pathology assessed the answers using modified version of the global quality score on a 5-point Likert scale. Additionally, readability was measured using the Flesch-Kincaid Grade Level and Flesch Reading Ease scores. Responses were also assessed for empathy using a validated 5-point scale. RESULTS: Specialists ranked GPT-4 with highest total score of 17.3 ± 1.5, while Bing received the lowest at 14.9 ± 2.2. Bard had the highest Flesch Reading Ease score of 62 ± 7; and ChatGPT-3.5 and Claude received the lowest scores (more challenging readability). GPT-4 and Bard emerged as the most superior chatbots in terms of empathy and accurate citations on patient-related frequently asked questions pertaining to oral cancer. GPT-4 had highest overall quality, whereas Bing showed the lowest level of quality, empathy, and accuracy for citations. CONCLUSION: GPT-4 demonstrated the highest quality responses to frequently asked questions pertaining to oral cancer. Although impressive in their ability to guide patients on common oral cancer topics, most chatbots did not perform well when assessed for empathy or citation accuracy.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Mouth NeoplasmsEmpathyArtificial IntelligenceSocial MediaHumansSurveys and QuestionnairesComprehensionGenerative Artificial Intelligence

Autor:innen und Institutionen

  • Department of Pediatric Dentistry, Loma Linda School of Dentistry, CA, USA.
  • Department of Oral Diagnostic Sciences & Research, School of Dentistry, Meharry Medical College, TN, USA.
  • Department of Dentistry and Oral Health, Aarhus University, Aarhus, Denmark.
  • Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran.
  • Division of Artificial Intelligence Research, Department of Oncology and Diagnostic Sciences, University of Maryland School of Dentistry, Baltimore, MD, USA.
  • Department of Comprehensive Dentistry, UT Health San Antonio, School of Dentistry, San Antonio, TX, USA.

Zitieren

APA

Rokhshad, R., Khoury, Z. H., Mohammad-Rahimi, H., Motie, P., Price, J. B., Tavares, T., Jessri, M., Bavarian, R., Sciubba, J. J., & Sultan, A. S. (2025). Efficacy and empathy of AI chatbots in answering frequently asked questions on oral oncology. Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology, 139(6), 719-728. https://doi.org/10.1016/j.oooo.2024.12.028

Vancouver

Rokhshad R, Khoury ZH, Mohammad-Rahimi H, Motie P, Price JB, Tavares T, et al. Efficacy and empathy of AI chatbots in answering frequently asked questions on oral oncology. Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology. 2025;139(6):719-728. doi:10.1016/j.oooo.2024.12.028

BibTeX
@article{Rokhshad2025,
  author = {Rokhshad, Rata and Khoury, Zaid H and Mohammad-Rahimi, Hossein and Motie, Parisa and Price, Jeffery B and Tavares, Tiffany and Jessri, Maryam and Bavarian, Roxanne and Sciubba, James J and Sultan, Ahmed S},
  title = {Efficacy and empathy of AI chatbots in answering frequently asked questions on oral oncology},
  journal = {Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology},
  year = {2025},
  volume = {139},
  number = {6},
  pages = {719--728},
  doi = {10.1016/j.oooo.2024.12.028}
}
Kostenlos starten →