Quality, Reliability, and Readability of Artificial Intelligence-Generated Information on Peri-Implant Diseases: A Comparative Study
Diagnostics · 19.11.2026 · 16 (22) · 3887
DOI: 10.3390/diagnostics16223887 ↗Kurz gefasst
Fachartikel in der Zeitschrift Diagnostics, online erschienen am 19.11.2026. Verfasst von Bilge Meracı Yıldıran und 3 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background/Objectives: The increasing use of dental implants has been accompanied by a rise in peri-implant diseases. As artificial intelligence (AI)-based chatbots are increasingly used to obtain health information, this study evaluated the reliability, quality, usefulness, and readability of responses generated by ChatGPT (GPT-4), Copilot (Smart GPT-5), and Gemini (3.0 Flash) to questions about peri-implant diseases.
Methods
Thirty-two AI-generated patient-oriented questions about peri-implant diseases were submitted to each chatbot. The responses were evaluated using the Global Quality Score (GQS), a 4-point usefulness scale, the modified DISCERN (mDISCERN) tool, the Flesch Reading Ease (FRE), and the Flesch-Kincaid Grade Level (FKGL). Inter-rater agreement before consensus was assessed using single-measure, absolute-agreement intraclass correlation coefficients (ICCs). Statistical analyses included the Shapiro-Wilk, Kruskal-Wallis, post hoc Bonferroni, and Spearman correlation tests.
Results
ChatGPT and Gemini had higher FRE scores and lower FKGL scores than Copilot (all adjusted p < 0.001). Copilot and Gemini had higher mDISCERN scores than ChatGPT (both adjusted p < 0.001), with no significant difference between Copilot and Gemini (adjusted p = 0.129). GQS and usefulness scores did not differ significantly across chatbots. Across the three chatbots, Spearman correlation coefficients ranged from −0.973 to −0.844 for the correlation between FRE and FKGL scores and from −0.773 to −0.509 for the correlation between GQS and usefulness scores.
Conclusions
ChatGPT and Gemini produced easier-to-read responses than Copilot, while Copilot and Gemini scored higher than ChatGPT on mDISCERN. The chatbots showed no significant differences in overall quality or usefulness scores. Given their potential limitations in clinical depth, AI-generated responses should be used only as supplementary educational resources and should not replace professional medical advice.
Zitieren
APA
Yıldıran, B. M., Uncu, S. A., Paksoy, T., & Gaş, S. (2026). Quality, Reliability, and Readability of Artificial Intelligence-Generated Information on Peri-Implant Diseases: A Comparative Study. Diagnostics, 16(22), 3887. https://doi.org/10.3390/diagnostics16223887
Vancouver
Yıldıran BM, Uncu SA, Paksoy T, Gaş S. Quality, Reliability, and Readability of Artificial Intelligence-Generated Information on Peri-Implant Diseases: A Comparative Study. Diagnostics. 2026;16(22):3887. doi:10.3390/diagnostics16223887
BibTeX
@article{Yldran2026,
author = {Yıldıran, Bilge Meracı and Uncu, Sevda Altınay and Paksoy, Tuğçe and Gaş, Selin},
title = {Quality, Reliability, and Readability of Artificial Intelligence-Generated Information on Peri-Implant Diseases: A Comparative Study},
journal = {Diagnostics},
year = {2026},
volume = {16},
number = {22},
pages = {3887},
doi = {10.3390/diagnostics16223887}
}
EUVIMED