A Comparison of a Customized Peripheral Artery Disease (PAD)-Specific Generative AI Chatbot and General-Purpose AI Chatbots for PAD Patient Education
Vergleich eines angepassten generativen KI-Chatbots für die periphere arterielle Verschlusskrankheit (PAD) mit allgemeinen KI-Chatbots für die Patientenaufklärung bei PAD
Journal of Clinical Medicine · 27.04.2026 · 15 (9) · 3317
DOI: 10.3390/jcm15093317 ↗Auf einen Blick
Ein PAD-spezifischer KI-Chatbot (VERA) erzeugte verständlichere Texte als drei allgemeine Chatbots. Die Genauigkeit war in allen Chatbots hoch.
Fragestellung
Wie schneidet ein für die PAD-Patientenaufklärung angepasster generativer KI-Chatbot im Vergleich zu öffentlich verfügbaren KI-Chatbots ab?
Methode
Querschnittliche Vergleichsstudie mit 4 KI-Chatbots und 10 PAD-Fragen; Bewertung von Lesbarkeit, Genauigkeit, Vollständigkeit und Patientenaufklärung per Instrumenten und Expertenrating.
Ergebnisse
VERA hatte die beste Zugänglichkeit und ein medianes Leseniveau von 6,6. Die Genauigkeit war bei allen Chatbots hoch ohne signifikante Unterschiede; VERA war jedoch weniger umfassend.
Einschränkungen
Verglichen wurden nur 10 Prompts; die Bewertung bezog sich auf Chatbot-Antworten, nicht auf klinische Effekte.
Schlussfolgerung der Autor:innen
Ein für PAD-Patientenaufklärung angepasster generativer KI-Chatbot liefert zugänglichere Texte ohne Genauigkeitsverlust, bei etwas geringerer Vollständigkeit durch bewusste Vereinfachung.
Kernaussagen
- VERA erzeugte die zugänglichsten Texte
- Medianes Leseniveau: 6,6
- Genauigkeit hoch; Vollständigkeit bei VERA geringer
Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.
Kurz gefasst
Fachartikel in der Zeitschrift Journal of Clinical Medicine, online erschienen am 27.04.2026. Verfasst von Aboubacar Cherif und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Northwestern University, Society for Vascular Surgery.
Abstract (Originalsprache)
Background/Objective: Patients with peripheral artery disease (PAD) are known to have poor awareness and understanding of the diagnosis. The role of generative AI chatbots in improving PAD patient education is unknown. Our goal is to compare a generative AI chatbot customized for PAD patient education to publicly available AI chatbots.
Methods
This is a cross-sectional comparative evaluation of the responses of four AI chatbots to ten prompts that are commonly asked questions about PAD. The three publicly available AI chatbots were ChatGPT-5, Gemini 2.5 Flash, and Claude Sonnet 4.5. We created a customized, voice AI chatbot for PAD education grounded on curated and prompt-injected guidance called Vascular Education and Resources using Artificial Intelligence, or “VERA.” De-identified chatbot-generated responses to inputs were assessed for readability (Flesch–Kincaid Grade Level, Flesch Reading Ease, Gunning Fog Index, Simple Measure of Gobbledygook Index, and Average Reading Level Consensus Score), accuracy, comprehensiveness, and patient education quality (Patient Education Materials Assessment Tool; PEMAT) using validated instruments and expert scoring rubrics. Nonparametric statistical testing was used to compare chatbot performance across all evaluation domains.
Results
VERA generated the most accessible text compared to the other chatbots and produced responses at a median grade level of 6.6, which was lower than responses from the other chatbots. PAD expert-rated accuracy scores were high across all the chatbots without significant differences between them. Comprehensiveness scores were more varied and demonstrated that VERA was less comprehensive than the other chatbots. PEMAT understandability scores were uniformly high. PEMAT actionability scores were low overall but did not differ significantly across chatbots on post hoc analysis.
Conclusions
A generative AI chatbot research tool customized for PAD patient education generates textual information about PAD that is more accessible (mean grade level 6.6) than publicly available AI chatbots without loss of accuracy, albeit with modestly reduced comprehensiveness that reflects intentional simplification for patient-centered communication. Future research will assess the acceptability and feasibility of this research tool to be adopted as part of PAD patient education.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA.
- David Geffen School of Medicine at UCLA, Los Angeles, CA 90095, USA.
- Department of Surgery, Federal University of Minas Gerais, Belo Horizonte 31270-901, MG, Brazil.
- Department of Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA.
ORCID-Profile: Megan E Alagna, Margaret A Reilly, Lara Lopes, David Liebovitz, Karen J Ho
Förderung
- Northwestern University
- Society for Vascular Surgery
Zitieren
APA
Cherif, A., Alagna, M. E., Reilly, M. A., Lopes, L., Crutcher, M., Schroeder, J., Carey, K. A., Brahmandam, A., Liebovitz, D., & Ho, K. J. (2026). A Comparison of a Customized Peripheral Artery Disease (PAD)-Specific Generative AI Chatbot and General-Purpose AI Chatbots for PAD Patient Education. Journal of Clinical Medicine, 15(9), 3317. https://doi.org/10.3390/jcm15093317
Vancouver
Cherif A, Alagna ME, Reilly MA, Lopes L, Crutcher M, Schroeder J, et al. A Comparison of a Customized Peripheral Artery Disease (PAD)-Specific Generative AI Chatbot and General-Purpose AI Chatbots for PAD Patient Education. Journal of Clinical Medicine. 2026;15(9):3317. doi:10.3390/jcm15093317
BibTeX
@article{Cherif2026,
author = {Cherif, Aboubacar and Alagna, Megan E and Reilly, Margaret A and Lopes, Lara and Crutcher, Madison and Schroeder, Jennifer and Carey, Kathryn A and Brahmandam, Anand and Liebovitz, David and Ho, Karen J},
title = {A Comparison of a Customized Peripheral Artery Disease (PAD)-Specific Generative AI Chatbot and General-Purpose AI Chatbots for PAD Patient Education},
journal = {Journal of Clinical Medicine},
year = {2026},
volume = {15},
number = {9},
pages = {3317},
doi = {10.3390/jcm15093317}
}
EUVIMED