EUVIMEDSkopri EUVIMED
BeobachtungsstudieOpen access

Development and Initial Evaluation of Specific Immersive Competence in Virtual Reality–Based Medical Assessments: Exploratory Observational Study

Verena Schreiner iD, Joy Backhaus iD, Marco Lindner iD, Melina Heinisch iD, Sarah König iD, Sebastian Oberdörfer iD, Tobias Mühling iD

JMIR Medical Education · 2026-04-08 · 12 · e82136

DOI: 10.2196/82136 ↗

At a glance

Beobachtungsstudie in JMIR Medical Education, published online on 2026-04-08. Written by Verena Schreiner and 6 co-authors. Institution: Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Germany. Major MEDLINE topics: Virtual Reality, Educational Measurement, Clinical Competence. Cited 4 times so far (Crossref); 45 references. The full text is freely available in PubMed Central.

AstrattSubjectsDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Background

Virtual reality (VR) is increasingly used in medical education for training and examination purposes; yet, learners’ performance in VR-based assessments may be influenced by more than clinical competence alone. Immersive competence (IC) has been proposed as a relevant factor in VR-based performance assessment. While general IC captures application-independent VR interaction skills, domain-specific applications may require an additional construct, specific immersive competence (specific IC), reflecting context-dependent interaction proficiency.

Objective

This study aimed to develop and examine the initial psychometric characteristics of a newly developed in situ checklist for assessing specific IC, to explore the relationship between specific and general IC as well as related human abilities and characteristics, and to capture preliminary associations between both IC measures and medical performance in a VR-based objective structured clinical examination (OSCE) station.

Methods

In this observational follow-up study, 21 final-year medical students who had previously completed a curricular OSCE including a VR-based emergency medicine station were recruited. General IC was assessed using the VR competence app, and specific IC using a checklist embedded in the original VR simulation. Additional measures included self-reported technological affinity, spatial ability, and OSCE performance scores. Analyses focused on descriptive statistics and exploratory associations, including item difficulty, item-total correlations, and internal consistency for the specific IC checklist. Pearson r was used to examine associations among variables.

Results

The final 13-item specific IC checklist demonstrated acceptable internal consistency for an early-stage instrument (Cronbach α=0.79) and balanced item difficulty (mean P 0.56, SD 0.28). Specific IC showed a strong exploratory association with general IC (r=0.56; P=.008) and with prior 3D application experience (r=0.57; P=.007), but no relevant association with spatial ability. Both general and specific IC showed borderline, moderate associations with VR-OSCE performance (r=0.41; P=.06 and r=0.37; P=.09, respectively), while neither was related to overall analog OSCE performance.

Conclusions

In this pilot sample, specific IC emerged as a psychometrically accessible construct aimed to capture context-sensitive VR interaction skills. The proposed in situ approach offers a feasible and scalable method to assess this construct within domain-specific VR applications. Although associations with medical performance were exploratory and limited by sample size, the findings suggest the relevance of IC as a potential source of construct-irrelevant variance in VR-based assessments and support further investigation in larger, confirmatory studies.

Subjects

MeSH terms (MEDLINE)

Virtual RealityEducational MeasurementClinical CompetenceHumansMaleFemalePsychometricsStudents, MedicalAdultEducation, Medical, Undergraduate

Author keywords

OSCEexploratory studyimmersive competencemedical educationobjective structured clinical examinationsperformance assessmentpilot studyvirtual reality

Authors and institutions

  • Institute of Medical Teaching and Medical Education Research, University Hospital Würzburg, Würzburg, Germany.
  • Chair for Human-Computer Interaction, Julius Maximilians University of Würzburg, Würzburg, Germany.

ORCID profiles: Verena Schreiner, Joy Backhaus, Marco Lindner, Melina Heinisch, Sarah König, Sebastian Oberdörfer, Tobias Mühling

Cite

APA

Schreiner, V., Backhaus, J., Lindner, M., Heinisch, M., König, S., Oberdörfer, S., & Mühling, T. (2026). Development and Initial Evaluation of Specific Immersive Competence in Virtual Reality–Based Medical Assessments: Exploratory Observational Study. JMIR Medical Education, 12, e82136. https://doi.org/10.2196/82136

Vancouver

Schreiner V, Backhaus J, Lindner M, Heinisch M, König S, Oberdörfer S, et al. Development and Initial Evaluation of Specific Immersive Competence in Virtual Reality–Based Medical Assessments: Exploratory Observational Study. JMIR Medical Education. 2026;12:e82136. doi:10.2196/82136

BibTeX
@article{Schreiner2026,
  author = {Schreiner, Verena and Backhaus, Joy and Lindner, Marco and Heinisch, Melina and König, Sarah and Oberdörfer, Sebastian and Mühling, Tobias},
  title = {Development and Initial Evaluation of Specific Immersive Competence in Virtual Reality–Based Medical Assessments: Exploratory Observational Study},
  journal = {JMIR Medical Education},
  year = {2026},
  volume = {12},
  pages = {e82136},
  doi = {10.2196/82136}
}
Start for free →