EUVIMEDScopri EUVIMED
Randomisierte kontrollierte StudieOpen access

Perceived Ratings of AI-Generated and Expert-Reviewed vs Clinician-Developed Virtual Cardiology Patient Scenarios Among Medical Students: Randomized Controlled Study

Marios Georgios Bantidos iD, Eleni Dafli iD, Efstratios Karagiannidis iD, Barbara Fyntanidou iD, Sotiria Gilou iD, Athina Nasoufidou iD, Panagiotis Bamidis iD

JMIR Medical Education · 2026

DOI: 10.2196/100839 ↗

At a glance

Randomisierte kontrollierte Studie in JMIR Medical Education, 2026. Written by Marios Georgios Bantidos and 6 co-authors. Institution: Lab of Medical Physics and Digital Innovation, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Central Macedonia, Greece. Major MEDLINE topics: Cardiology, Students, Medical, Patient Simulation, Artificial Intelligence. 37 references. The full text is freely available in PubMed Central.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

Background

Virtual patients (VPs) are widely used in medical education, but creating high-quality cases requires clinical expertise, iterative revision, and alignment with educational objectives. Generative AI may support VP authoring, but direct comparisons between AI-generated and clinician-developed cases delivered within the same educational setting remain limited.

Objective

This study aimed to compare medical students’ learner-perceived ratings of 1 AI-generated, expert-reviewed virtual cardiology patient scenario with those of 1 clinician-developed virtual cardiology patient scenario delivered through the same mobile platform.

Methods

A randomized, participant-blinded 2-arm controlled study was conducted in October 2025 during scheduled fifth-year emergency medicine course sessions. Eligible participants were fifth-year medical students who had completed the cardiology course. Students were assigned 1:1 to complete either a clinician-developed VP (CD-VP; n=64) or a ChatGPT-generated VP (GPT-VP; n=67). Both scenarios followed a shared acute coronary syndrome blueprint and were delivered through the same mobile-optimized app (mobile VPs app [MobiViP]) with identical interface structure and branching logic. The GPT-VP was generated using GPT-5 and refined through iterative follow-up prompting under expert review; direct manual rewriting was prohibited. After completion, students completed a mandatory 19-item questionnaire covering realism and validity, cognitive load, self-reported learning and reflection, and engagement and satisfaction. Analyses included reliability testing, 1-sample tests against a neutral midpoint, Mann-Whitney U tests, and Spearman correlations. Full scenario content and development details are provided as multimedia appendices.

Results

A total of 131 complete questionnaires were analyzed, with no item-level missing data. Mean subscale scores in the CD-VP group were 3.81 (SD 0.64) for realism and validity, 3.67 (SD 0.74) for cognitive load, 3.64 (SD 0.73) for self-reported learning and reflection, and 4.16 (SD 0.64) for engagement and satisfaction; corresponding GPT-VP scores were 4.11 (SD 0.56), 3.03 (SD 0.76), 3.86 (SD 0.77), and 4.28 (SD 0.58), respectively. Compared with the CD-VP, the GPT-VP received higher ratings for realism and validity (Mann-Whitney U=1503.0; P=.003) and lower cognitive load ratings, indicating a lower perceived burden (Mann-Whitney U=1070.5; P

Subjects

MeSH terms (MEDLINE)

CardiologyStudents, MedicalPatient SimulationArtificial IntelligenceHumansMaleFemaleGenerative Artificial IntelligenceAdultEducation, Medical, UndergraduateClinical CompetenceSurveys and Questionnaires

Author keywords

ChatGPTRCTVPscardiologygenerative AIgenerative artificial intelligencemedical educationrandomized controlled trialvirtual patients

Authors and institutions

  • Lab of Medical Physics and Digital Innovation, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Central Macedonia, Greece.
  • Department of Emergency Medicine, AHEPA University General Hospital, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Central Macedonia, Greece.
  • Second Department of Cardiology, Hippokration General Hospital, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Central Macedonia, Greece.

ORCID profiles: Marios Georgios Bantidos, Eleni Dafli, Efstratios Karagiannidis, Barbara Fyntanidou, Sotiria Gilou, Athina Nasoufidou, Panagiotis Bamidis

Cite

APA

Bantidos, M. G., Dafli, E., Karagiannidis, E., Fyntanidou, B., Gilou, S., Nasoufidou, A., & Bamidis, P. (2026). Perceived Ratings of AI-Generated and Expert-Reviewed vs Clinician-Developed Virtual Cardiology Patient Scenarios Among Medical Students: Randomized Controlled Study. JMIR Medical Education. https://doi.org/10.2196/100839

Vancouver

Bantidos MG, Dafli E, Karagiannidis E, Fyntanidou B, Gilou S, Nasoufidou A, et al. Perceived Ratings of AI-Generated and Expert-Reviewed vs Clinician-Developed Virtual Cardiology Patient Scenarios Among Medical Students: Randomized Controlled Study. JMIR Medical Education. 2026. doi:10.2196/100839

BibTeX
@article{Bantidos2026,
  author = {Bantidos, Marios Georgios and Dafli, Eleni and Karagiannidis, Efstratios and Fyntanidou, Barbara and Gilou, Sotiria and Nasoufidou, Athina and Bamidis, Panagiotis},
  title = {Perceived Ratings of AI-Generated and Expert-Reviewed vs Clinician-Developed Virtual Cardiology Patient Scenarios Among Medical Students: Randomized Controlled Study},
  journal = {JMIR Medical Education},
  year = {2026},
  doi = {10.2196/100839}
}
Start for free →