EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluating artificial intelligence chatbots for patient education in oral and maxillofacial radiology

Dilek Helvacioglu-Yigit, Husniye Demirturk, Kamran Ali, Dania Tamimi, Lisa Koenig, Abeer Almashraqi

Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology · 2025-06 · 139 (6) · 750-759

DOI: 10.1016/j.oooo.2025.01.001 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology, 2025-06. Verfasst von Dilek Helvacioglu-Yigit und 5 weiteren Autor:innen. Beteiligte Einrichtung: College of Dental Medicine, QU Health, Qatar University, Doha, Qatar. Electronic address: dilek@qu.edu.qa. Hauptthemen laut MEDLINE: Artificial Intelligence, Patient Education as Topic, Radiology, Radiography, Dental. Die Arbeit wurde bisher 46-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Qatar National Library.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

OBJECTIVE: This study aimed to compare the quality and readability of the responses generated by 3 publicly available artificial intelligence (AI) chatbots in answering frequently asked questions (FAQs) related to Oral and Maxillofacial Radiology (OMR) to assess their suitability for patient education. STUDY DESIGN: Fifteen OMR-related questions were selected from professional patient information websites. These questions were posed to ChatGPT-3.5 by OpenAI, Gemini 1.5 Pro by Google, and Copilot by Microsoft to generate responses. Three board-certified OMR specialists evaluated the responses regarding scientific adequacy, ease of understanding, and overall reader satisfaction. Readability was assessed using the Flesch-Kincaid Grade Level (FKGL) and Flesch Reading Ease (FRE) scores. The Wilcoxon signed-rank test was conducted to compare the scores assigned by the evaluators to the responses from the chatbots and professional websites. Interevaluator agreement was examined by calculating the Fleiss kappa coefficient. RESULTS: There were no significant differences between groups in terms of scientific adequacy. In terms of readability, chatbots had overall mean FKGL and FRE scores of 12.97 and 34.11, respectively. Interevaluator agreement level was generally high. CONCLUSIONS: Although chatbots are relatively good at responding to FAQs, validating AI-generated information using input from healthcare professionals can enhance patient care and safety. Readability of the text content in the chatbots and websites requires high reading levels.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligencePatient Education as TopicRadiologyRadiography, DentalHumansComprehensionInternetGenerative Artificial Intelligence

Autor:innen und Institutionen

  • College of Dental Medicine, QU Health, Qatar University, Doha, Qatar. Electronic address: dilek@qu.edu.qa.
  • University of Pittsburgh School of Dental Medicine, Pittsburgh, PA, USA; Oral and Maxillofacial Radiology Consultant, Private Practice, Wexford, PA, USA.
  • College of Dental Medicine, QU Health, Qatar University, Doha, Qatar.
  • Oral and Maxillofacial Radiology Consultant, Private Practice, Orlando, FL, USA.
  • Marquette University School of Dentistry, Milwaukee, WI, USA.

Förderung

  • Qatar National Library

Zitieren

APA

Helvacioglu-Yigit, D., Demirturk, H., Ali, K., Tamimi, D., Koenig, L., & Almashraqi, A. (2025). Evaluating artificial intelligence chatbots for patient education in oral and maxillofacial radiology. Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology, 139(6), 750-759. https://doi.org/10.1016/j.oooo.2025.01.001

Vancouver

Helvacioglu-Yigit D, Demirturk H, Ali K, Tamimi D, Koenig L, Almashraqi A. Evaluating artificial intelligence chatbots for patient education in oral and maxillofacial radiology. Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology. 2025;139(6):750-759. doi:10.1016/j.oooo.2025.01.001

BibTeX
@article{HelvaciogluYigit2025,
  author = {Helvacioglu-Yigit, Dilek and Demirturk, Husniye and Ali, Kamran and Tamimi, Dania and Koenig, Lisa and Almashraqi, Abeer},
  title = {Evaluating artificial intelligence chatbots for patient education in oral and maxillofacial radiology},
  journal = {Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology},
  year = {2025},
  volume = {139},
  number = {6},
  pages = {750--759},
  doi = {10.1016/j.oooo.2025.01.001}
}
Kostenlos starten →