Evaluation of information provided by artificial intelligence chatbots on extraoral maxillofacial prostheses
The Journal of Prosthetic Dentistry · 2025-12 · 134 (6) · 2623.e1-2623.e8
DOI: 10.1016/j.prosdent.2025.08.028 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of Prosthetic Dentistry, 2025-12. Verfasst von Nuran Özyemişci und 5 weiteren Autor:innen. Beteiligte Einrichtung: Associate Professor, Dental Prosthesis Technology, Vocational School of Health Services, Hacettepe University, Ankara, Turkey. Electronic address: no…. Hauptthemen laut MEDLINE: Artificial Intelligence, Maxillofacial Prosthesis. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 36 Literaturangaben.
Abstract (Originalsprache)
STATEMENT OF PROBLEM: Despite advances in artificial intelligence (AI), the quality, reliability, and understandability of health-related information provided by chatbots is still a question mark. Furthermore, studies on maxillofacial prosthesis (MP) information from AI chatbots are lacking. PURPOSE: The purpose of this study was to assess and compare the reliability, quality, readability, and similarity of responses to MP-related questions generated by 4 different chatbots. MATERIAL AND METHODS: A total of 15 questions were provided by a maxillofacial prosthodontist and from 4 different chatbots (ChatGPT-3.5, Gemini 2.5 Flash, Copilot, and DeepSeek V3). The Reliability Scoring (adapted DISCERN), the Global Quality Scale (GQS), the Flesch Reading Ease Score (FRES), the Flesch-Kincaid Reading Grade Level (FKRGL), and the Similarity Index (iThenticate) were used to evaluate the performance of chatbots. Data were compared using the Kruskal-Wallis test, and the differences between chatbots were determined by the Conover multiple comparison test with Benjamini-Hochberg correction (α=.05). RESULTS: There were no significant differences between the chatbots' DISCERN scores, except for one question where ChatGPT showed significantly higher reliability than Gemini or Copilot (P=.03). There was no statistically significant difference among AI tools in terms of GQS values (P=.096), FRES values (P=.166), and FKRGL values (P=.247). The similarity rate of Gemini was statistically higher than other AI chatbots (P=.03). CONCLUSIONS: ChatGPT-3.5, Gemini 2.5 Flash, Copilot, and DeepSeek V3 showed good quality responses. All chatbots' responses were difficult for non-professionals to read and understand. Low similarity rates were found for all chatbots except Gemini, indicating originality of their information.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Associate Professor, Dental Prosthesis Technology, Vocational School of Health Services, Hacettepe University, Ankara, Turkey. Electronic address: nozyemisci@yahoo.com.
- Professor, Department of Prosthodontics, Faculty of Dentistry, Gazi University, Ankara, Turkey.
- Research Assistant, Department of Prosthodontics, Faculty of Dentistry, Gazi University, Ankara, Turkey.
- PhD student, Department of Prosthodontics, Faculty of Dentistry, Gazi University, Ankara, Turkey.
Zitieren
APA
Özyemişci, N., Bal, B. T., Güngör, M. B., Öztürk, E. K., Canvar, A., & Nemli, S. K. (2025). Evaluation of information provided by artificial intelligence chatbots on extraoral maxillofacial prostheses. The Journal of Prosthetic Dentistry, 134(6), 2623.e1-2623.e8. https://doi.org/10.1016/j.prosdent.2025.08.028
Vancouver
Özyemişci N, Bal BT, Güngör MB, Öztürk EK, Canvar A, Nemli SK. Evaluation of information provided by artificial intelligence chatbots on extraoral maxillofacial prostheses. The Journal of Prosthetic Dentistry. 2025;134(6):2623.e1-2623.e8. doi:10.1016/j.prosdent.2025.08.028
BibTeX
@article{zyemici2025,
author = {Özyemişci, Nuran and Bal, Bilge Turhan and Güngör, Merve Bankoğlu and Öztürk, Esra Kaynak and Canvar, Ayşegül and Nemli, Secil Karakoca},
title = {Evaluation of information provided by artificial intelligence chatbots on extraoral maxillofacial prostheses},
journal = {The Journal of Prosthetic Dentistry},
year = {2025},
volume = {134},
number = {6},
pages = {2623.e1--2623.e8},
doi = {10.1016/j.prosdent.2025.08.028}
}
EUVIMED