EUVIMEDEUVIMED entdecken
Vergleichsstudie

Assessing the Quality of AI Explanations of Atrial Fibrillation: Comparative Analysis of ChatGPT and Google Gemini

Jasneel Kahlam iD, Alexander Sacher iD, Kyrollos Saad iD, David Zhang iD, Rohit Sekandalapuram iD, Quang Dai La iD, David F Lo iD, John P Reilly iD

JMIR Formative Research · 05.11.2026 · 10 · e73715

DOI: 10.2196/73715 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift JMIR Formative Research, online erschienen am 05.11.2026. Verfasst von Jasneel Kahlam und 7 weiteren Autor:innen. Beteiligte Einrichtung: Stony Brook Southampton Hospital, Southampton, NY, United States. Hauptthemen laut MEDLINE: Atrial Fibrillation, Artificial Intelligence, Patient Education as Topic. Die Arbeit nennt 25 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Atrial fibrillation (AF) is one of the most common arrhythmias and is associated with multiple risk factors, including stroke and heart failure. Therefore, it is important that accurate and comprehensive educational resources on AF are available. Artificial intelligence (AI) platforms such as Google Gemini and ChatGPT are emerging tools for medical education. To our knowledge, this is the first study to assess the quality of these platforms for AF education.

Objective

This pilot study aimed to (1) assess the quality of ChatGPT and Google Gemini explanations of AF and its treatment, (2) compare responses from both platforms, and (3) analyze differences in interpretation between cardiologists and nonmedical professionals.

Methods

The prompt “Explain atrial fibrillation and how to treat it to a patient” was entered into both ChatGPT and Google Gemini. The responses, along with a survey created in Google Forms, were sent out to potential participants between September and October 2024. The survey questions were derived from the Patient Education Materials Assessment Tool for Printable Materials and DISCERN criteria. Each survey question was multiple choice and rated on a 5-point Likert scale, where 1 indicated strong disagreement and 5 indicated strong agreement. Averages of each answer from the survey were calculated and compared using the Wilcoxon signed-rank test.

Results

The survey was completed by 28 participants, including cardiologists and cardiology fellows and 17 nonmedical professionals (college graduates not employed in the medical field). No significant overall quality differences were observed between ChatGPT and Google Gemini. When comparing participant groups, cardiologists rated AI-generated responses higher than nonmedical professionals for perceived bias (mean 3.82 vs mean 4.33; P=.04) and for explaining consequences of no treatment (mean 2.85 vs mean 1.86; P=.005). In contrast, nonmedical professionals rated structural and organizational features more favorably than cardiologists, including visual cues (mean 3.97 vs mean 2.48; P

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Atrial FibrillationArtificial IntelligencePatient Education as TopicHumansPilot ProjectsSurveys and QuestionnairesFemaleGenerative Artificial IntelligenceMaleAdultMiddle Aged

Stichwörter der Autor:innen

ChatGPTGoogle Geminiartificial intelligenceatrial fibrillationmedical education

Autor:innen und Institutionen

  • Stony Brook Southampton Hospital, Southampton, NY, United States.
  • Department of Internal Medicine, Department of Internal Medicine, New York Hospital Queens, Flushing, NY, United States.
  • Department of Cardiology, Deborah Heart and Lung Center, Browns Mills, NJ, United States.
  • Stony Brook University Hospital, Stony Brook, NY, United States.
  • Brooklyn Hospital Center, Brooklyn, NY, United States.
  • American Preventive Screening & Education Association, Stratford, NJ, United States.

ORCID-Profile: Jasneel Kahlam, Alexander Sacher, Kyrollos Saad, David Zhang, Rohit Sekandalapuram, Quang Dai La, David F Lo, John P Reilly

Zitieren

APA

Kahlam, J., Sacher, A., Saad, K., Zhang, D., Sekandalapuram, R., La, Q. D., Lo, D. F., & Reilly, J. P. (2026). Assessing the Quality of AI Explanations of Atrial Fibrillation: Comparative Analysis of ChatGPT and Google Gemini. JMIR Formative Research, 10, e73715. https://doi.org/10.2196/73715

Vancouver

Kahlam J, Sacher A, Saad K, Zhang D, Sekandalapuram R, La QD, et al. Assessing the Quality of AI Explanations of Atrial Fibrillation: Comparative Analysis of ChatGPT and Google Gemini. JMIR Formative Research. 2026;10:e73715. doi:10.2196/73715

BibTeX
@article{Kahlam2026,
  author = {Kahlam, Jasneel and Sacher, Alexander and Saad, Kyrollos and Zhang, David and Sekandalapuram, Rohit and La, Quang Dai and Lo, David F and Reilly, John P},
  title = {Assessing the Quality of AI Explanations of Atrial Fibrillation: Comparative Analysis of ChatGPT and Google Gemini},
  journal = {JMIR Formative Research},
  year = {2026},
  volume = {10},
  pages = {e73715},
  doi = {10.2196/73715}
}
Kostenlos starten →