EUVIMEDEUVIMED entdecken
QuerschnittstudieOpen Access · CC BY 4.0

Artificial Intelligence Chatbots in Peritoneal Dialysis Education: A Cross-Sectional Comparative Study of Quality, Readability, and Reliability

Engin Onan iD, İlter Bozaci, Yelda Deligoz Bildaci iD, Sevinc Puren Yucel Karakaya, Ruya Kozanoglu, Rumeyza Kazancioglu

Journal of Clinical Medicine · 15.01.2026 · 15 (2) · 692

DOI: 10.3390/jcm15020692 ↗

Kurz gefasst

Querschnittstudie in der Zeitschrift Journal of Clinical Medicine, online erschienen am 15.01.2026. Verfasst von Engin Onan und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Nephrology, Adana Dr. Turgut Noyan Training and Research Hospital, Faculty of Medicine, Baskent University, Adana 01120, Turkey. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Peritoneal dialysis (PD) remains underutilized worldwide, partly due to limited patient education, misconceptions, and barriers to accessing reliable health information. Artificial intelligence (AI)-based chatbots have emerged as promising tools for improving health literacy, supporting shared decision-making, and enhancing patient engagement. However, concerns regarding content quality, reliability, and readability persist, and no study to date has systematically evaluated AI-generated content in the context of PD. Therefore, this study aimed to systematically evaluate the quality, reliability, and readability of AI-generated educational content on peritoneal dialysis using multiple large language model-based chatbots.

Methods

A total of 45 frequently asked questions about PD were developed by nephrology experts and categorized into three domains: general information (n = 15), technical and clinical issues (n = 21), and myths/misconceptions (n = 9). Three AI-based chatbots, Gemini Pro 2.5, ChatGPT-5, and LLaMA Maverick 4, were prompted to generate responses to all questions. Each response was independently evaluated by two blinded reviewers for textual characteristics, readability using the Flesch Reading Ease Score (FRES) and Flesch-Kincaid Grade Level (FKGL), and content quality/reliability using the Ensuring Quality Information for Patients (EQIP) tool and the Modified DISCERN instrument.

Results

Across all domains, significant differences were observed among the chatbots. Gemini Pro 2.5 achieved higher Flesch Reading Ease (FRES) scores (32.6 ± 10.5) compared with ChatGPT-5 (24.2 ± 11.7) and LLaMA Maverick 4 (16.2 ± 7.5; p < 0.001), as well as higher EQIP scores (75.4% vs. 59.4% and 61.5%, respectively; p < 0.001) and Modified DISCERN scores (4.0 [4.0–4.5] vs. 3.0 [3.0–3.5] and 3.0 [2.5–3.5]; p < 0.001). ChatGPT-5 demonstrated intermediate performance, while LLaMA Maverick 4 showed lower scores across evaluated metrics.

Conclusions

These findings demonstrate differences among AI-based chatbots in readability, content quality, and reliability when responding to identical peritoneal dialysis–related questions. While AI chatbots may support health literacy and complement clinical decision-making, their outputs should be interpreted with caution and under appropriate clinical oversight. Future research should focus on multilingual, multicenter, and outcome-based studies to ensure the safe integration of AI into PD patient education.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligence chatbotspatient educationperitoneal dialysisreadability and reliability

Autor:innen und Institutionen

  • Department of Nephrology, Adana Dr. Turgut Noyan Training and Research Hospital, Faculty of Medicine, Baskent University, Adana 01120, Turkey.
  • Department of Nephrology, Antalya City Training and Research Hospital, Muratpaşa 07100, Turkey.
  • Department of Nephrology, Faculty of Medicine, Dokuz Eylul University, Izmir 35340, Turkey.
  • Department of Biostatistics, Faculty of Medicine, Cukurova University, Adana 01330, Turkey.
  • Department of Nephrology, Faculty of Medicine, Bezmialem Vakif University, Istanbul 34093, Turkey.

ORCID-Profile: Engin Onan, Yelda Deligoz Bildaci

Zitieren

APA

Onan, E., Bozaci, İ., Bildaci, Y. D., Karakaya, S. P. Y., Kozanoglu, R., & Kazancioglu, R. (2026). Artificial Intelligence Chatbots in Peritoneal Dialysis Education: A Cross-Sectional Comparative Study of Quality, Readability, and Reliability. Journal of Clinical Medicine, 15(2), 692. https://doi.org/10.3390/jcm15020692

Vancouver

Onan E, Bozaci İ, Bildaci YD, Karakaya SPY, Kozanoglu R, Kazancioglu R. Artificial Intelligence Chatbots in Peritoneal Dialysis Education: A Cross-Sectional Comparative Study of Quality, Readability, and Reliability. Journal of Clinical Medicine. 2026;15(2):692. doi:10.3390/jcm15020692

BibTeX
@article{Onan2026,
  author = {Onan, Engin and Bozaci, İlter and Bildaci, Yelda Deligoz and Karakaya, Sevinc Puren Yucel and Kozanoglu, Ruya and Kazancioglu, Rumeyza},
  title = {Artificial Intelligence Chatbots in Peritoneal Dialysis Education: A Cross-Sectional Comparative Study of Quality, Readability, and Reliability},
  journal = {Journal of Clinical Medicine},
  year = {2026},
  volume = {15},
  number = {2},
  pages = {692},
  doi = {10.3390/jcm15020692}
}
Kostenlos starten →