Development and Initial Evaluation of Specific Immersive Competence in Virtual Reality–Based Medical Assessments: Exploratory Observational Study
JMIR Medical Education · 08.04.2026 · 12 · e82136
DOI: 10.2196/82136 ↗Kurz gefasst
Beobachtungsstudie in der Zeitschrift JMIR Medical Education, online erschienen am 08.04.2026. Verfasst von Verena Schreiner und 6 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Germany. Hauptthemen laut MEDLINE: Virtual Reality, Educational Measurement, Clinical Competence. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Virtual reality (VR) is increasingly used in medical education for training and examination purposes; yet, learners’ performance in VR-based assessments may be influenced by more than clinical competence alone. Immersive competence (IC) has been proposed as a relevant factor in VR-based performance assessment. While general IC captures application-independent VR interaction skills, domain-specific applications may require an additional construct, specific immersive competence (specific IC), reflecting context-dependent interaction proficiency.
Objective
This study aimed to develop and examine the initial psychometric characteristics of a newly developed in situ checklist for assessing specific IC, to explore the relationship between specific and general IC as well as related human abilities and characteristics, and to capture preliminary associations between both IC measures and medical performance in a VR-based objective structured clinical examination (OSCE) station.
Methods
In this observational follow-up study, 21 final-year medical students who had previously completed a curricular OSCE including a VR-based emergency medicine station were recruited. General IC was assessed using the VR competence app, and specific IC using a checklist embedded in the original VR simulation. Additional measures included self-reported technological affinity, spatial ability, and OSCE performance scores. Analyses focused on descriptive statistics and exploratory associations, including item difficulty, item-total correlations, and internal consistency for the specific IC checklist. Pearson r was used to examine associations among variables.
Results
The final 13-item specific IC checklist demonstrated acceptable internal consistency for an early-stage instrument (Cronbach α=0.79) and balanced item difficulty (mean P 0.56, SD 0.28). Specific IC showed a strong exploratory association with general IC (r=0.56; P=.008) and with prior 3D application experience (r=0.57; P=.007), but no relevant association with spatial ability. Both general and specific IC showed borderline, moderate associations with VR-OSCE performance (r=0.41; P=.06 and r=0.37; P=.09, respectively), while neither was related to overall analog OSCE performance.
Conclusions
In this pilot sample, specific IC emerged as a psychometrically accessible construct aimed to capture context-sensitive VR interaction skills. The proposed in situ approach offers a feasible and scalable method to assess this construct within domain-specific VR applications. Although associations with medical performance were exploratory and limited by sample size, the findings suggest the relevance of IC as a potential source of construct-irrelevant variance in VR-based assessments and support further investigation in larger, confirmatory studies.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Germany.
- Chair for Human-Computer Interaction, Julius Maximilians University of Würzburg, Würzburg, Germany.
ORCID-Profile: Verena Schreiner, Joy Backhaus, Marco Lindner, Melina Heinisch, Sarah König, Sebastian Oberdörfer, Tobias Mühling
Zitieren
APA
Schreiner, V., Backhaus, J., Lindner, M., Heinisch, M., König, S., Oberdörfer, S., & Mühling, T. (2026). Development and Initial Evaluation of Specific Immersive Competence in Virtual Reality–Based Medical Assessments: Exploratory Observational Study. JMIR Medical Education, 12, e82136. https://doi.org/10.2196/82136
Vancouver
Schreiner V, Backhaus J, Lindner M, Heinisch M, König S, Oberdörfer S, et al. Development and Initial Evaluation of Specific Immersive Competence in Virtual Reality–Based Medical Assessments: Exploratory Observational Study. JMIR Medical Education. 2026;12:e82136. doi:10.2196/82136
BibTeX
@article{Schreiner2026,
author = {Schreiner, Verena and Backhaus, Joy and Lindner, Marco and Heinisch, Melina and König, Sarah and Oberdörfer, Sebastian and Mühling, Tobias},
title = {Development and Initial Evaluation of Specific Immersive Competence in Virtual Reality–Based Medical Assessments: Exploratory Observational Study},
journal = {JMIR Medical Education},
year = {2026},
volume = {12},
pages = {e82136},
doi = {10.2196/82136}
}
EUVIMED