Comparing Virtual Reality–Based and Traditional Physical Objective Structured Clinical Examination (OSCE) Stations for Clinical Competency Assessments: Randomized Controlled Trial
Journal of Medical Internet Research · 2025-01-10 · 27 · e55066
DOI: 10.2196/55066 ↗At a glance
Randomisierte kontrollierte Studie in Journal of Medical Internet Research, published online on 2025-01-10. Written by Tobias Mühling and 4 co-authors. Institution: Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Germany. Major MEDLINE topics: Virtual Reality, Clinical Competence. Cited 31 times so far (Crossref); 27 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
Objective structured clinical examinations (OSCEs) are a widely recognized and accepted method to assess clinical competencies but are often resource-intensive.
Objective
This study aimed to evaluate the feasibility and effectiveness of a virtual reality (VR)–based station (VRS) compared with a traditional physical station (PHS) in an already established curricular OSCE.
Methods
Fifth-year medical students participated in an OSCE consisting of 10 stations. One of the stations, emergency medicine, was offered in 2 modalities: VRS and PHS. Students were randomly assigned to 1 of the 2 modalities. We used 2 distinct scenarios to prevent content leakage among participants. Student performance and item characteristics were analyzed, comparing the VRS with PHS as well as with 5 other case-based stations. Student perceptions of the VRS were collected through a quantitative and qualitative postexamination online survey, which included a 5-point Likert scale ranging from 1 (minimum) to 5 (maximum), to evaluate the acceptance and usability of the VR system. Organizational and technical feasibility as well as cost-effectiveness were also evaluated.
Results
Following randomization and exclusions of invalid data sets, 57 and 66 participants were assessed for the VRS and PHS, respectively. The feasibility evaluation demonstrated smooth implementation of both VR scenarios (septic and anaphylactic shock) with 93% (53/57) of students using the VR technology without issues. The difficulty levels of the VRS scenarios (septic shock: P=.67; anaphylactic shock: P=.58) were comparable to the average difficulty of all stations (P=.68) and fell within the reference range (0.4-0.8). In contrast, VRS demonstrated above-average values for item discrimination (septic shock: r'=0.40; anaphylactic shock: r'=0.33; overall r'=0.30; with values >0.3 considered good) and discrimination index (septic shock: D=0.25; anaphylactic shock: D=0.26; overall D=0.16, with 0.2-0.3 considered mediocre and
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Germany.
ORCID profiles: Tobias Mühling, Verena Schreiner, Marc Appel, Tobias Leutritz, Sarah König
Cite
APA
Mühling, T., Schreiner, V., Appel, M., Leutritz, T., & König, S. (2025). Comparing Virtual Reality–Based and Traditional Physical Objective Structured Clinical Examination (OSCE) Stations for Clinical Competency Assessments: Randomized Controlled Trial. Journal of Medical Internet Research, 27, e55066. https://doi.org/10.2196/55066
Vancouver
Mühling T, Schreiner V, Appel M, Leutritz T, König S. Comparing Virtual Reality–Based and Traditional Physical Objective Structured Clinical Examination (OSCE) Stations for Clinical Competency Assessments: Randomized Controlled Trial. Journal of Medical Internet Research. 2025;27:e55066. doi:10.2196/55066
BibTeX
@article{Mhling2025,
author = {Mühling, Tobias and Schreiner, Verena and Appel, Marc and Leutritz, Tobias and König, Sarah},
title = {Comparing Virtual Reality–Based and Traditional Physical Objective Structured Clinical Examination (OSCE) Stations for Clinical Competency Assessments: Randomized Controlled Trial},
journal = {Journal of Medical Internet Research},
year = {2025},
volume = {27},
pages = {e55066},
doi = {10.2196/55066}
}
EUVIMED