Using AI-Based Virtual Simulated Patients for Training in Psychopathological Interviewing: Cross-Sectional Observational Study
JMIR Medical Education · 23.12.2025 · 11 · e78857
DOI: 10.2196/78857 ↗Kurz gefasst
Beobachtungsstudie in der Zeitschrift JMIR Medical Education, online erschienen am 23.12.2025. Verfasst von Daniel García-Torres und 4 weiteren Autor:innen. Beteiligte Einrichtung: Departamento de Psicología de la Salud, Universidad Miguel Hernández, Elche, Spain. Hauptthemen laut MEDLINE: Artificial Intelligence, Patient Simulation, Interview, Psychological, Psychology. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Virtual simulated patients (VSPs) powered by generative artificial intelligence (GAI) offer a promising tool for training clinical interviewing skills; yet, little is known about how different system- and user-level variables shape students’ perceptions of these interactions.
Objective
We aim to study psychology students’ perceptions of GAI-driven VSPs and examine how demographic factors, system parameters, and interaction characteristics influence such perceptions.
Methods
We conducted a total of 1832 recorded interactions involving 156 psychology students with 13 GAI-generated VSPs configured with varying temperature settings (0.1, 0.5, 0.9). For each student, we collected age and sex; for each interview, we recorded interview length (total number of question–answer turns), number of connectivity failures, the specific VSP consulted, and the model temperature. After every interview, students provided a 1-10 global rating and open-ended comments regarding strengths and areas for improvement. At the end of the training sequence, they also reported perceived improvement in diagnostic ability. Statistical analyses assessed the influence of different variables on global ratings: demographics, interaction-level data, and GAI temperature setting. Sentiment analysis was conducted to evaluate the VSPs’ clinical realism.
Results
Statistical analysis showed that female students rated the tool significantly higher (mean rating 9.25/10) than male students (mean rating 8.94/10; Kruskal-Wallis test, H=8.7; P=.003). On the other side, no significant correlation was found between global rating and age (r=0.02, 95% CI –0.03 to 0.06; P=.42), interview length (r=0.04, 95% CI –0.2 to 0.10; P=.18), or frequency of participation (Kruskal-Wallis test, H=4.62; P=.20). A moderate negative correlation emerged between connectivity failures and ratings (r=–0.26, 95% CI –0.41 to –0.10; P=.002). Temperature settings significantly influenced ratings (Kruskal-Wallis test, H=6.93; P=.03; η²=0.02), with higher scores at temperature 0.9 compared with 0.1 (Dunn’s test, P=.04). Concerning learning outcomes, self-perceived improvement in diagnostic ability was reported by 94% (94/100) of students; however, final practical examination scores (mean 6.67, SD 1.42) did not differ significantly from those of the previous cohort without VSP training (mean 6.42, SD 1.56). Sentiment analysis indicated predominantly negative sentiment in GAI responses (median negativity 0.8903, IQR 0.306-0.961), consistent with clinical realism.
Conclusions
GAI-driven VSPs were well-received by psychology students, with student gender and system-level variables (particularly temperature settings and connection stability) shaping user evaluations. Although participants perceived the training as beneficial for their diagnostic skills, objective examination performance did not significantly differ from the previous cohort. However, lack of randomization limits the generalization of the results obtained, and further experiments are required.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Departamento de Psicología de la Salud, Universidad Miguel Hernández, Elche, Spain.
- Fundación para el Fomento de la Investigación Sanitaria y Biomédica de la Comunitat Valenciana, Alicante, Spain.
ORCID-Profile: Daniel García-Torres, César Fernández, José Joaquín Mira, Alexandra Morales, María Asunción Vicente
Zitieren
APA
García-Torres, D., Fernández, C., Mira, J. J., Morales, A., & Vicente, M. A. (2025). Using AI-Based Virtual Simulated Patients for Training in Psychopathological Interviewing: Cross-Sectional Observational Study. JMIR Medical Education, 11, e78857. https://doi.org/10.2196/78857
Vancouver
García-Torres D, Fernández C, Mira JJ, Morales A, Vicente MA. Using AI-Based Virtual Simulated Patients for Training in Psychopathological Interviewing: Cross-Sectional Observational Study. JMIR Medical Education. 2025;11:e78857. doi:10.2196/78857
BibTeX
@article{GarcaTorres2025,
author = {García-Torres, Daniel and Fernández, César and Mira, José Joaquín and Morales, Alexandra and Vicente, María Asunción},
title = {Using AI-Based Virtual Simulated Patients for Training in Psychopathological Interviewing: Cross-Sectional Observational Study},
journal = {JMIR Medical Education},
year = {2025},
volume = {11},
pages = {e78857},
doi = {10.2196/78857}
}
EUVIMED