EUVIMEDOpdag EUVIMED
Open access

Enhancing Medical Interview Skills Through AI-Simulated Patient Interactions: Nonrandomized Controlled Trial

Akira Yamamoto iD, Masahide Koda iD, Hiroko Ogawa iD, Tomoko Miyoshi iD, Yoshinobu Maeda iD, Fumio Otsuka iD, Hideo Ino iD

JMIR Medical Education · 2024-09-23 · 10 · e58753

DOI: 10.2196/58753 ↗

At a glance

Journal article in JMIR Medical Education, published online on 2024-09-23. Written by Akira Yamamoto and 6 co-authors. Institution: Department of Hematology and Oncology, Okayama University Hospital, Okayama, Japan, Okayama, Japan. Major MEDLINE topics: Artificial Intelligence, Clinical Competence, Patient Simulation. Cited 112 times so far (Crossref); 32 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Medical interviewing is a critical skill in clinical practice, yet opportunities for practical training are limited in Japanese medical schools, necessitating urgent measures. Given advancements in artificial intelligence (AI) technology, its application in the medical field is expanding. However, reports on its application in medical interviews in medical education are scarce.

Objective

This study aimed to investigate whether medical students’ interview skills could be improved by engaging with AI-simulated patients using large language models, including the provision of feedback.

Methods

This nonrandomized controlled trial was conducted with fourth-year medical students in Japan. A simulation program using large language models was provided to 35 students in the intervention group in 2023, while 110 students from 2022 who did not participate in the intervention were selected as the control group. The primary outcome was the score on the Pre-Clinical Clerkship Objective Structured Clinical Examination (pre-CC OSCE), a national standardized clinical skills examination, in medical interviewing. Secondary outcomes included surveys such as the Simulation-Based Training Quality Assurance Tool (SBT-QA10), administered at the start and end of the study.

Results

The AI intervention group showed significantly higher scores on medical interviews than the control group (AI group vs control group: mean 28.1, SD 1.6 vs 27.1, SD 2.2; P=.01). There was a trend of inverse correlation between the SBT-QA10 and pre-CC OSCE scores (regression coefficient –2.0 to –2.1). No significant safety concerns were observed.

Conclusions

Education through medical interviews using AI-simulated patients has demonstrated safety and a certain level of educational effectiveness. However, at present, the educational effects of this platform on nonverbal communication skills are limited, suggesting that it should be used as a supplementary tool to traditional simulation education.

Subjects

MeSH terms (MEDLINE)

Artificial IntelligenceClinical CompetencePatient SimulationHumansFemaleMaleStudents, MedicalJapanEducational MeasurementInterviews as TopicEducation, Medical, UndergraduateSimulation Training

Author keywords

OSCEartificial intelligencegenerative pretrained transformerlarge language modelmedical educationmedical interviewnonrandomized controlled trialsimulated patientssimulation-based learning

Authors and institutions

  • Department of Hematology and Oncology, Okayama University Hospital, Okayama, Japan, Okayama, Japan.
  • Co-learning Community Healthcare Re-innovation Office, Graduate School of Medicine, Dentistry and Pharmaceutical Sciences, Okayama University, Okayama, Japan, Okayama, Japan.
  • Department of Primary Care and Medical Education, Dentistry and Pharmaceutical Sciences, Okayama University Graduate School of Medicine, Okayama, Japan, Okayama, Japan.
  • Department of General Medicine, Okayama University Graduate School of Medicine, Dentistry and Pharmaceutical Sciences, Okayama, Japan, Okayama, Japan.
  • Center for Education in Medicine and Health Sciences, Okayama University Graduate School of Medicine, Dentistry and Pharmaceutical Sciences, Okayama, Japan, Okayama, Japan.

ORCID profiles: Akira Yamamoto, Masahide Koda, Hiroko Ogawa, Tomoko Miyoshi, Yoshinobu Maeda, Fumio Otsuka, Hideo Ino

Cite

APA

Yamamoto, A., Koda, M., Ogawa, H., Miyoshi, T., Maeda, Y., Otsuka, F., & Ino, H. (2024). Enhancing Medical Interview Skills Through AI-Simulated Patient Interactions: Nonrandomized Controlled Trial. JMIR Medical Education, 10, e58753. https://doi.org/10.2196/58753

Vancouver

Yamamoto A, Koda M, Ogawa H, Miyoshi T, Maeda Y, Otsuka F, et al. Enhancing Medical Interview Skills Through AI-Simulated Patient Interactions: Nonrandomized Controlled Trial. JMIR Medical Education. 2024;10:e58753. doi:10.2196/58753

BibTeX
@article{Yamamoto2024,
  author = {Yamamoto, Akira and Koda, Masahide and Ogawa, Hiroko and Miyoshi, Tomoko and Maeda, Yoshinobu and Otsuka, Fumio and Ino, Hideo},
  title = {Enhancing Medical Interview Skills Through AI-Simulated Patient Interactions: Nonrandomized Controlled Trial},
  journal = {JMIR Medical Education},
  year = {2024},
  volume = {10},
  pages = {e58753},
  doi = {10.2196/58753}
}
Start for free →