Perceived Ratings of AI-Generated and Expert-Reviewed vs Clinician-Developed Virtual Cardiology Patient Scenarios Among Medical Students: Randomized Controlled Study
JMIR Medical Education · 2026
DOI: 10.2196/100839 ↗Kurz gefasst
Randomisierte kontrollierte Studie in der Zeitschrift JMIR Medical Education, 2026. Verfasst von Marios Georgios Bantidos und 6 weiteren Autor:innen. Beteiligte Einrichtung: Lab of Medical Physics and Digital Innovation, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Central Macedonia, Greece. Hauptthemen laut MEDLINE: Cardiology, Students, Medical, Patient Simulation, Artificial Intelligence. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Virtual patients (VPs) are widely used in medical education, but creating high-quality cases requires clinical expertise, iterative revision, and alignment with educational objectives. Generative AI may support VP authoring, but direct comparisons between AI-generated and clinician-developed cases delivered within the same educational setting remain limited.
Objective
This study aimed to compare medical students’ learner-perceived ratings of 1 AI-generated, expert-reviewed virtual cardiology patient scenario with those of 1 clinician-developed virtual cardiology patient scenario delivered through the same mobile platform.
Methods
A randomized, participant-blinded 2-arm controlled study was conducted in October 2025 during scheduled fifth-year emergency medicine course sessions. Eligible participants were fifth-year medical students who had completed the cardiology course. Students were assigned 1:1 to complete either a clinician-developed VP (CD-VP; n=64) or a ChatGPT-generated VP (GPT-VP; n=67). Both scenarios followed a shared acute coronary syndrome blueprint and were delivered through the same mobile-optimized app (mobile VPs app [MobiViP]) with identical interface structure and branching logic. The GPT-VP was generated using GPT-5 and refined through iterative follow-up prompting under expert review; direct manual rewriting was prohibited. After completion, students completed a mandatory 19-item questionnaire covering realism and validity, cognitive load, self-reported learning and reflection, and engagement and satisfaction. Analyses included reliability testing, 1-sample tests against a neutral midpoint, Mann-Whitney U tests, and Spearman correlations. Full scenario content and development details are provided as multimedia appendices.
Results
A total of 131 complete questionnaires were analyzed, with no item-level missing data. Mean subscale scores in the CD-VP group were 3.81 (SD 0.64) for realism and validity, 3.67 (SD 0.74) for cognitive load, 3.64 (SD 0.73) for self-reported learning and reflection, and 4.16 (SD 0.64) for engagement and satisfaction; corresponding GPT-VP scores were 4.11 (SD 0.56), 3.03 (SD 0.76), 3.86 (SD 0.77), and 4.28 (SD 0.58), respectively. Compared with the CD-VP, the GPT-VP received higher ratings for realism and validity (Mann-Whitney U=1503.0; P=.003) and lower cognitive load ratings, indicating a lower perceived burden (Mann-Whitney U=1070.5; P
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Lab of Medical Physics and Digital Innovation, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Central Macedonia, Greece.
- Department of Emergency Medicine, AHEPA University General Hospital, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Central Macedonia, Greece.
- Second Department of Cardiology, Hippokration General Hospital, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Central Macedonia, Greece.
ORCID-Profile: Marios Georgios Bantidos, Eleni Dafli, Efstratios Karagiannidis, Barbara Fyntanidou, Sotiria Gilou, Athina Nasoufidou, Panagiotis Bamidis
Zitieren
APA
Bantidos, M. G., Dafli, E., Karagiannidis, E., Fyntanidou, B., Gilou, S., Nasoufidou, A., & Bamidis, P. (2026). Perceived Ratings of AI-Generated and Expert-Reviewed vs Clinician-Developed Virtual Cardiology Patient Scenarios Among Medical Students: Randomized Controlled Study. JMIR Medical Education. https://doi.org/10.2196/100839
Vancouver
Bantidos MG, Dafli E, Karagiannidis E, Fyntanidou B, Gilou S, Nasoufidou A, et al. Perceived Ratings of AI-Generated and Expert-Reviewed vs Clinician-Developed Virtual Cardiology Patient Scenarios Among Medical Students: Randomized Controlled Study. JMIR Medical Education. 2026. doi:10.2196/100839
BibTeX
@article{Bantidos2026,
author = {Bantidos, Marios Georgios and Dafli, Eleni and Karagiannidis, Efstratios and Fyntanidou, Barbara and Gilou, Sotiria and Nasoufidou, Athina and Bamidis, Panagiotis},
title = {Perceived Ratings of AI-Generated and Expert-Reviewed vs Clinician-Developed Virtual Cardiology Patient Scenarios Among Medical Students: Randomized Controlled Study},
journal = {JMIR Medical Education},
year = {2026},
doi = {10.2196/100839}
}
EUVIMED