Artificial Intelligence Chatbots in Peritoneal Dialysis Education: A Cross-Sectional Comparative Study of Quality, Readability, and Reliability
Journal of Clinical Medicine · 15.01.2026 · 15 (2) · 692
DOI: 10.3390/jcm15020692 ↗Kurz gefasst
Querschnittstudie in der Zeitschrift Journal of Clinical Medicine, online erschienen am 15.01.2026. Verfasst von Engin Onan und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Nephrology, Adana Dr. Turgut Noyan Training and Research Hospital, Faculty of Medicine, Baskent University, Adana 01120, Turkey. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Peritoneal dialysis (PD) remains underutilized worldwide, partly due to limited patient education, misconceptions, and barriers to accessing reliable health information. Artificial intelligence (AI)-based chatbots have emerged as promising tools for improving health literacy, supporting shared decision-making, and enhancing patient engagement. However, concerns regarding content quality, reliability, and readability persist, and no study to date has systematically evaluated AI-generated content in the context of PD. Therefore, this study aimed to systematically evaluate the quality, reliability, and readability of AI-generated educational content on peritoneal dialysis using multiple large language model-based chatbots.
Methods
A total of 45 frequently asked questions about PD were developed by nephrology experts and categorized into three domains: general information (n = 15), technical and clinical issues (n = 21), and myths/misconceptions (n = 9). Three AI-based chatbots, Gemini Pro 2.5, ChatGPT-5, and LLaMA Maverick 4, were prompted to generate responses to all questions. Each response was independently evaluated by two blinded reviewers for textual characteristics, readability using the Flesch Reading Ease Score (FRES) and Flesch-Kincaid Grade Level (FKGL), and content quality/reliability using the Ensuring Quality Information for Patients (EQIP) tool and the Modified DISCERN instrument.
Results
Across all domains, significant differences were observed among the chatbots. Gemini Pro 2.5 achieved higher Flesch Reading Ease (FRES) scores (32.6 ± 10.5) compared with ChatGPT-5 (24.2 ± 11.7) and LLaMA Maverick 4 (16.2 ± 7.5; p < 0.001), as well as higher EQIP scores (75.4% vs. 59.4% and 61.5%, respectively; p < 0.001) and Modified DISCERN scores (4.0 [4.0–4.5] vs. 3.0 [3.0–3.5] and 3.0 [2.5–3.5]; p < 0.001). ChatGPT-5 demonstrated intermediate performance, while LLaMA Maverick 4 showed lower scores across evaluated metrics.
Conclusions
These findings demonstrate differences among AI-based chatbots in readability, content quality, and reliability when responding to identical peritoneal dialysis–related questions. While AI chatbots may support health literacy and complement clinical decision-making, their outputs should be interpreted with caution and under appropriate clinical oversight. Future research should focus on multilingual, multicenter, and outcome-based studies to ensure the safe integration of AI into PD patient education.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Nephrology, Adana Dr. Turgut Noyan Training and Research Hospital, Faculty of Medicine, Baskent University, Adana 01120, Turkey.
- Department of Nephrology, Antalya City Training and Research Hospital, Muratpaşa 07100, Turkey.
- Department of Nephrology, Faculty of Medicine, Dokuz Eylul University, Izmir 35340, Turkey.
- Department of Biostatistics, Faculty of Medicine, Cukurova University, Adana 01330, Turkey.
- Department of Nephrology, Faculty of Medicine, Bezmialem Vakif University, Istanbul 34093, Turkey.
ORCID-Profile: Engin Onan, Yelda Deligoz Bildaci
Zitieren
APA
Onan, E., Bozaci, İ., Bildaci, Y. D., Karakaya, S. P. Y., Kozanoglu, R., & Kazancioglu, R. (2026). Artificial Intelligence Chatbots in Peritoneal Dialysis Education: A Cross-Sectional Comparative Study of Quality, Readability, and Reliability. Journal of Clinical Medicine, 15(2), 692. https://doi.org/10.3390/jcm15020692
Vancouver
Onan E, Bozaci İ, Bildaci YD, Karakaya SPY, Kozanoglu R, Kazancioglu R. Artificial Intelligence Chatbots in Peritoneal Dialysis Education: A Cross-Sectional Comparative Study of Quality, Readability, and Reliability. Journal of Clinical Medicine. 2026;15(2):692. doi:10.3390/jcm15020692
BibTeX
@article{Onan2026,
author = {Onan, Engin and Bozaci, İlter and Bildaci, Yelda Deligoz and Karakaya, Sevinc Puren Yucel and Kozanoglu, Ruya and Kazancioglu, Rumeyza},
title = {Artificial Intelligence Chatbots in Peritoneal Dialysis Education: A Cross-Sectional Comparative Study of Quality, Readability, and Reliability},
journal = {Journal of Clinical Medicine},
year = {2026},
volume = {15},
number = {2},
pages = {692},
doi = {10.3390/jcm15020692}
}
EUVIMED