EUVIMEDObjevte EUVIMED
Randomisierte kontrollierte StudieOpen access

Utility of Generative Artificial Intelligence for Japanese Medical Interview Training: Randomized Crossover Pilot Study

Takanobu Hirosawa iD, Masashi Yokose iD, Tetsu Sakamoto iD, Yukinori Harada iD, Kazuki Tokumasu iD, Kazuya Mizuta iD, Taro Shimizu iD

JMIR Medical Education · 2025

DOI: 10.2196/77332 ↗

At a glance

Randomisierte kontrollierte Studie in JMIR Medical Education, 2025. Written by Takanobu Hirosawa and 6 co-authors. Institution: Department of Diagnostic and Generalist Medicine, Dokkyo Medical University, 880 Kitakobayashi, Mibu-cho, Shimotsuga, 321-0293, Japan, 81 282861111. Major MEDLINE topics: Artificial Intelligence, Interviews as Topic. Cited 22 times so far (Crossref); 70 references. The full text is freely available in PubMed Central.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Background

The medical interview remains a cornerstone of clinical training. There is growing interest in applying generative artificial intelligence (AI) in medical education, including medical interview training. However, its utility in culturally and linguistically specific contexts, including Japanese, remains underexplored. This study investigated the utility of generative AI for Japanese medical interview training.

Objective

This pilot study aimed to evaluate the utility of generative AI as a tool for medical interview training by comparing its performance with that of traditional face-to-face training methods using a simulated patient.

Methods

We conducted a randomized crossover pilot study involving 20 postgraduate year 1‐2 physicians from a university hospital. Participants were randomly allocated into 2 groups. Group A began with an AI-based station on a case involving abdominal pain, followed by a traditional station with a standardized patient presenting chest pain. Group B followed the reverse order, starting with the traditional station for abdominal pain and subsequently within the AI-based station for the chest pain scenario. In the AI-based stations, participants interacted with a GPT-configured platform that simulated patient behaviors. GPTs are customizable versions of ChatGPT adapted for specific purposes. The traditional stations involved face-to-face interviews with a simulated patient. Both groups used identical, standardized case scenarios to ensure uniformity. Two independent evaluators, blinded to the study conditions, assessed participants’ performances using 6 defined metrics: patient care and communication, history taking, physical examination, accuracy and clarity of transcription, clinical reasoning, and patient management. A 6-point Likert scale was used for scoring. The discrepancy between the evaluators was resolved through discussion. To ensure cultural and linguistic authenticity, all interviews and evaluations were conducted in Japanese.

Results

AI-based stations scored lower across most categories, particularly in patient care and communication, than traditional stations (4.48 vs 4.95; P =.009). However, AI-based stations demonstrated comparable performance in clinical reasoning, with a nonsignificant difference (4.43 vs 4.85; P =.10).

Conclusions

The comparable performance of generative AI in clinical reasoning highlights its potential as a complementary tool in medical interview training. One of its main advantages lies in enabling self-learning, allowing trainees to independently practice interviews without the need for simulated patients. Nonetheless, the lower scores in patient care and communication underline the importance of maintaining traditional methods that capture the nuances of human interaction. These findings support the adoption of hybrid training models that combine generative AI with conventional approaches to enhance the overall effectiveness of medical interview training in Japan.

Subjects

MeSH terms (MEDLINE)

Artificial IntelligenceInterviews as TopicHumansPilot ProjectsCross-Over StudiesJapanFemaleMaleAdultClinical CompetenceGenerative Artificial IntelligenceEast Asian People

Author keywords

artificial intelligencegenerative artificial intelligencemedical interview trainingmock patientsimulation education

Authors and institutions

  • Department of Diagnostic and Generalist Medicine, Dokkyo Medical University, 880 Kitakobayashi, Mibu-cho, Shimotsuga, 321-0293, Japan, 81 282861111.
  • Department of General Medicine, Graduate School of Medicine, Dentistry and Pharmaceutical Sciences, Okayama University, Okayama, Japan.
  • Department of Intensive Care Medicine, Kameda Medical Center, Chiba, Japan.

ORCID profiles: Takanobu Hirosawa, Masashi Yokose, Tetsu Sakamoto, Yukinori Harada, Kazuki Tokumasu, Kazuya Mizuta, Taro Shimizu

Cite

APA

Hirosawa, T., Yokose, M., Sakamoto, T., Harada, Y., Tokumasu, K., Mizuta, K., & Shimizu, T. (2025). Utility of Generative Artificial Intelligence for Japanese Medical Interview Training: Randomized Crossover Pilot Study. JMIR Medical Education. https://doi.org/10.2196/77332

Vancouver

Hirosawa T, Yokose M, Sakamoto T, Harada Y, Tokumasu K, Mizuta K, et al. Utility of Generative Artificial Intelligence for Japanese Medical Interview Training: Randomized Crossover Pilot Study. JMIR Medical Education. 2025. doi:10.2196/77332

BibTeX
@article{Hirosawa2025,
  author = {Hirosawa, Takanobu and Yokose, Masashi and Sakamoto, Tetsu and Harada, Yukinori and Tokumasu, Kazuki and Mizuta, Kazuya and Shimizu, Taro},
  title = {Utility of Generative Artificial Intelligence for Japanese Medical Interview Training: Randomized Crossover Pilot Study},
  journal = {JMIR Medical Education},
  year = {2025},
  doi = {10.2196/77332}
}
Start for free →