Mass Casualty Incident Training in Immersive Virtual Reality: Quasi-Experimental Evaluation of Multimethod Performance Indicators
Journal of Medical Internet Research · 2025-01-27 · 27 · e63241
DOI: 10.2196/63241 ↗At a glance
Journal article in Journal of Medical Internet Research, published online on 2025-01-27. Written by Anke Sabine Baetzner and 11 co-authors. Institution: Institute of Sports and Sports Sciences, Heidelberg University, Heidelberg, Germany. Major MEDLINE topics: Mass Casualty Incidents, Virtual Reality, Emergency Responders. Cited 16 times so far (Crossref); 78 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
Immersive virtual reality (iVR) has emerged as a training method to prepare medical first responders (MFRs) for mass casualty incidents (MCIs) and disasters in a resource-efficient, flexible, and safe manner. However, systematic evaluations and validations of potential performance indicators for virtual MCI training are still lacking.
Objective
This study aimed to investigate whether different performance indicators based on visual attention, triage performance, and information transmission can be effectively extended to MCI training in iVR by testing if they can discriminate between different levels of expertise. Furthermore, the study examined the extent to which such objective indicators correlate with subjective performance assessments.
Methods
A total of 76 participants (mean age 25.54, SD 6.01 y; 45/76, 59% male) with different medical expertise (MFRs: paramedics and emergency physicians; non-MFRs: medical students, in-hospital nurses, and other physicians) participated in 5 virtual MCI scenarios of varying complexity in a randomized order. Tasks involved assessing the situation, triaging virtual patients, and transmitting relevant information to a control center. Performance indicators included eye-tracking–based visual attention, triage accuracy, triage speed, information transmission efficiency, and self-assessment of performance. Expertise was determined based on the occupational group (39/76, 51% MFRs vs 37/76, 49% non-MFRs) and a knowledge test with patient vignettes.
Results
Triage accuracy (d=0.48), triage speed (d=0.42), and information transmission efficiency (d=1.13) differentiated significantly between MFRs and non-MFRs. In addition, higher triage accuracy was significantly associated with higher triage knowledge test scores (Spearman ρ=0.40). Visual attention was not significantly associated with expertise. Furthermore, subjective performance was not correlated with any other performance indicator. Conclusions iVR-based MCI scenarios proved to be a valuable tool for assessing the performance of MFRs. The results suggest that iVR could be integrated into current MCI training curricula to provide frequent, objective, and potentially (partly) automated performance assessments in a controlled environment. In particular, performance indicators, such as triage accuracy, triage speed, and information transmission efficiency, capture multiple aspects of performance and are recommended for integration. While the examined visual attention indicators did not function as valid performance indicators in this study, future research could further explore visual attention in MCI training and examine other indicators, such as holistic gaze patterns. Overall, the results underscore the importance of integrating objective indicators to enhance trainers’ feedback and provide trainees with guidance on evaluating and reflecting on their own performance.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Institute of Sports and Sports Sciences, Heidelberg University, Heidelberg, Germany.
- Department of Human Movement Sciences, Faculty of Behavioral and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.
- Institute of Brain and Behaviour Amsterdam, Amsterdam, Netherlands.
- Lyda Hill Institute for Human Resilience, University of Colorado Colorado Springs, Colorado Springs, CO, United States.
- MindConsole GmbH, Graz, Austria.
- Department of Emergency Medicine, Inselspital University Hospital, University of Bern, Bern, Switzerland.
ORCID profiles: Anke Sabine Baetzner, Yannick Hill, Benjamin Roszipal, Solène Gerwann, Matthias Beutel, Tanja Birrenbach, Markus Karlseder, Stefan Mohr, Gabriel Alexander Salg, Helmut Schrom-Feiertag, Marie Ottilie Frenkel, Cornelia Wrzus
Cite
APA
Baetzner, A. S., Hill, Y., Roszipal, B., Gerwann, S., Beutel, M., Birrenbach, T., Karlseder, M., Mohr, S., Salg, G. A., Schrom-Feiertag, H., Frenkel, M. O., & Wrzus, C. (2025). Mass Casualty Incident Training in Immersive Virtual Reality: Quasi-Experimental Evaluation of Multimethod Performance Indicators. Journal of Medical Internet Research, 27, e63241. https://doi.org/10.2196/63241
Vancouver
Baetzner AS, Hill Y, Roszipal B, Gerwann S, Beutel M, Birrenbach T, et al. Mass Casualty Incident Training in Immersive Virtual Reality: Quasi-Experimental Evaluation of Multimethod Performance Indicators. Journal of Medical Internet Research. 2025;27:e63241. doi:10.2196/63241
BibTeX
@article{Baetzner2025,
author = {Baetzner, Anke Sabine and Hill, Yannick and Roszipal, Benjamin and Gerwann, Solène and Beutel, Matthias and Birrenbach, Tanja and Karlseder, Markus and Mohr, Stefan and Salg, Gabriel Alexander and Schrom-Feiertag, Helmut and Frenkel, Marie Ottilie and Wrzus, Cornelia},
title = {Mass Casualty Incident Training in Immersive Virtual Reality: Quasi-Experimental Evaluation of Multimethod Performance Indicators},
journal = {Journal of Medical Internet Research},
year = {2025},
volume = {27},
pages = {e63241},
doi = {10.2196/63241}
}
EUVIMED