EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Comparison of a Customized Peripheral Artery Disease (PAD)-Specific Generative AI Chatbot and General-Purpose AI Chatbots for PAD Patient Education

Vergleich eines angepassten generativen KI-Chatbots für die periphere arterielle Verschlusskrankheit (PAD) mit allgemeinen KI-Chatbots für die Patientenaufklärung bei PAD

Aboubacar Cherif, Megan E Alagna iD, Margaret A Reilly iD, Lara Lopes iD, Madison Crutcher, Jennifer Schroeder, Kathryn A Carey, Anand Brahmandam, David Liebovitz iD, Karen J Ho iD

Journal of Clinical Medicine · 27.04.2026 · 15 (9) · 3317

DOI: 10.3390/jcm15093317 ↗

Auf einen Blick

Ein PAD-spezifischer KI-Chatbot (VERA) erzeugte verständlichere Texte als drei allgemeine Chatbots. Die Genauigkeit war in allen Chatbots hoch.

Fragestellung

Wie schneidet ein für die PAD-Patientenaufklärung angepasster generativer KI-Chatbot im Vergleich zu öffentlich verfügbaren KI-Chatbots ab?

Methode

Querschnittliche Vergleichsstudie mit 4 KI-Chatbots und 10 PAD-Fragen; Bewertung von Lesbarkeit, Genauigkeit, Vollständigkeit und Patientenaufklärung per Instrumenten und Expertenrating.

Ergebnisse

VERA hatte die beste Zugänglichkeit und ein medianes Leseniveau von 6,6. Die Genauigkeit war bei allen Chatbots hoch ohne signifikante Unterschiede; VERA war jedoch weniger umfassend.

Einschränkungen

Verglichen wurden nur 10 Prompts; die Bewertung bezog sich auf Chatbot-Antworten, nicht auf klinische Effekte.

Schlussfolgerung der Autor:innen

Ein für PAD-Patientenaufklärung angepasster generativer KI-Chatbot liefert zugänglichere Texte ohne Genauigkeitsverlust, bei etwas geringerer Vollständigkeit durch bewusste Vereinfachung.

Kernaussagen

  • VERA erzeugte die zugänglichsten Texte
  • Medianes Leseniveau: 6,6
  • Genauigkeit hoch; Vollständigkeit bei VERA geringer

Deutsche Zusammenfassung: KI-gestützt aus dem Original-Abstract erstellt; alle Zahlen wurden automatisch mit dem Original abgeglichen. Maßgeblich ist der Original-Abstract.

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Clinical Medicine, online erschienen am 27.04.2026. Verfasst von Aboubacar Cherif und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Northwestern University, Society for Vascular Surgery.

Auf einen BlickAbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background/Objective: Patients with peripheral artery disease (PAD) are known to have poor awareness and understanding of the diagnosis. The role of generative AI chatbots in improving PAD patient education is unknown. Our goal is to compare a generative AI chatbot customized for PAD patient education to publicly available AI chatbots.

Methods

This is a cross-sectional comparative evaluation of the responses of four AI chatbots to ten prompts that are commonly asked questions about PAD. The three publicly available AI chatbots were ChatGPT-5, Gemini 2.5 Flash, and Claude Sonnet 4.5. We created a customized, voice AI chatbot for PAD education grounded on curated and prompt-injected guidance called Vascular Education and Resources using Artificial Intelligence, or “VERA.” De-identified chatbot-generated responses to inputs were assessed for readability (Flesch–Kincaid Grade Level, Flesch Reading Ease, Gunning Fog Index, Simple Measure of Gobbledygook Index, and Average Reading Level Consensus Score), accuracy, comprehensiveness, and patient education quality (Patient Education Materials Assessment Tool; PEMAT) using validated instruments and expert scoring rubrics. Nonparametric statistical testing was used to compare chatbot performance across all evaluation domains.

Results

VERA generated the most accessible text compared to the other chatbots and produced responses at a median grade level of 6.6, which was lower than responses from the other chatbots. PAD expert-rated accuracy scores were high across all the chatbots without significant differences between them. Comprehensiveness scores were more varied and demonstrated that VERA was less comprehensive than the other chatbots. PEMAT understandability scores were uniformly high. PEMAT actionability scores were low overall but did not differ significantly across chatbots on post hoc analysis.

Conclusions

A generative AI chatbot research tool customized for PAD patient education generates textual information about PAD that is more accessible (mean grade level 6.6) than publicly available AI chatbots without loss of accuracy, albeit with modestly reduced comprehensiveness that reflects intentional simplification for patient-centered communication. Future research will assess the acceptability and feasibility of this research tool to be adopted as part of PAD patient education.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligencedigital healthpatient educationperipheral artery disease

Autor:innen und Institutionen

  • Department of Surgery, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA.
  • David Geffen School of Medicine at UCLA, Los Angeles, CA 90095, USA.
  • Department of Surgery, Federal University of Minas Gerais, Belo Horizonte 31270-901, MG, Brazil.
  • Department of Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL 60611, USA.

ORCID-Profile: Megan E Alagna, Margaret A Reilly, Lara Lopes, David Liebovitz, Karen J Ho

Förderung

  • Northwestern University
  • Society for Vascular Surgery

Zitieren

APA

Cherif, A., Alagna, M. E., Reilly, M. A., Lopes, L., Crutcher, M., Schroeder, J., Carey, K. A., Brahmandam, A., Liebovitz, D., & Ho, K. J. (2026). A Comparison of a Customized Peripheral Artery Disease (PAD)-Specific Generative AI Chatbot and General-Purpose AI Chatbots for PAD Patient Education. Journal of Clinical Medicine, 15(9), 3317. https://doi.org/10.3390/jcm15093317

Vancouver

Cherif A, Alagna ME, Reilly MA, Lopes L, Crutcher M, Schroeder J, et al. A Comparison of a Customized Peripheral Artery Disease (PAD)-Specific Generative AI Chatbot and General-Purpose AI Chatbots for PAD Patient Education. Journal of Clinical Medicine. 2026;15(9):3317. doi:10.3390/jcm15093317

BibTeX
@article{Cherif2026,
  author = {Cherif, Aboubacar and Alagna, Megan E and Reilly, Margaret A and Lopes, Lara and Crutcher, Madison and Schroeder, Jennifer and Carey, Kathryn A and Brahmandam, Anand and Liebovitz, David and Ho, Karen J},
  title = {A Comparison of a Customized Peripheral Artery Disease (PAD)-Specific Generative AI Chatbot and General-Purpose AI Chatbots for PAD Patient Education},
  journal = {Journal of Clinical Medicine},
  year = {2026},
  volume = {15},
  number = {9},
  pages = {3317},
  doi = {10.3390/jcm15093317}
}
Kostenlos starten →