EUVIMEDSkopri EUVIMED
Open access

Mass Casualty Incident Training in Immersive Virtual Reality: Quasi-Experimental Evaluation of Multimethod Performance Indicators

Anke Sabine Baetzner iD, Yannick Hill iD, Benjamin Roszipal iD, Solène Gerwann iD, Matthias Beutel iD, Tanja Birrenbach iD, Markus Karlseder iD, Stefan Mohr iD, Gabriel Alexander Salg iD, Helmut Schrom-Feiertag iD, Marie Ottilie Frenkel iD, Cornelia Wrzus iD

Journal of Medical Internet Research · 2025-01-27 · 27 · e63241

DOI: 10.2196/63241 ↗

At a glance

Journal article in Journal of Medical Internet Research, published online on 2025-01-27. Written by Anke Sabine Baetzner and 11 co-authors. Institution: Institute of Sports and Sports Sciences, Heidelberg University, Heidelberg, Germany. Major MEDLINE topics: Mass Casualty Incidents, Virtual Reality, Emergency Responders. Cited 16 times so far (Crossref); 78 references. The full text is freely available in PubMed Central.

AstrattSubjectsDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Background

Immersive virtual reality (iVR) has emerged as a training method to prepare medical first responders (MFRs) for mass casualty incidents (MCIs) and disasters in a resource-efficient, flexible, and safe manner. However, systematic evaluations and validations of potential performance indicators for virtual MCI training are still lacking.

Objective

This study aimed to investigate whether different performance indicators based on visual attention, triage performance, and information transmission can be effectively extended to MCI training in iVR by testing if they can discriminate between different levels of expertise. Furthermore, the study examined the extent to which such objective indicators correlate with subjective performance assessments.

Methods

A total of 76 participants (mean age 25.54, SD 6.01 y; 45/76, 59% male) with different medical expertise (MFRs: paramedics and emergency physicians; non-MFRs: medical students, in-hospital nurses, and other physicians) participated in 5 virtual MCI scenarios of varying complexity in a randomized order. Tasks involved assessing the situation, triaging virtual patients, and transmitting relevant information to a control center. Performance indicators included eye-tracking–based visual attention, triage accuracy, triage speed, information transmission efficiency, and self-assessment of performance. Expertise was determined based on the occupational group (39/76, 51% MFRs vs 37/76, 49% non-MFRs) and a knowledge test with patient vignettes.

Results

Triage accuracy (d=0.48), triage speed (d=0.42), and information transmission efficiency (d=1.13) differentiated significantly between MFRs and non-MFRs. In addition, higher triage accuracy was significantly associated with higher triage knowledge test scores (Spearman ρ=0.40). Visual attention was not significantly associated with expertise. Furthermore, subjective performance was not correlated with any other performance indicator. Conclusions iVR-based MCI scenarios proved to be a valuable tool for assessing the performance of MFRs. The results suggest that iVR could be integrated into current MCI training curricula to provide frequent, objective, and potentially (partly) automated performance assessments in a controlled environment. In particular, performance indicators, such as triage accuracy, triage speed, and information transmission efficiency, capture multiple aspects of performance and are recommended for integration. While the examined visual attention indicators did not function as valid performance indicators in this study, future research could further explore visual attention in MCI training and examine other indicators, such as holistic gaze patterns. Overall, the results underscore the importance of integrating objective indicators to enhance trainers’ feedback and provide trainees with guidance on evaluating and reflecting on their own performance.

Subjects

MeSH terms (MEDLINE)

Mass Casualty IncidentsVirtual RealityEmergency RespondersHumansMaleAdultFemaleTriage

Author keywords

disaster medicineemergency medicineemergency simulationeye trackingmass casualty incidentmedical educationprehospital decision-makingvirtual reality

Authors and institutions

  • Institute of Sports and Sports Sciences, Heidelberg University, Heidelberg, Germany.
  • Department of Human Movement Sciences, Faculty of Behavioral and Movement Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands.
  • Institute of Brain and Behaviour Amsterdam, Amsterdam, Netherlands.
  • Lyda Hill Institute for Human Resilience, University of Colorado Colorado Springs, Colorado Springs, CO, United States.
  • MindConsole GmbH, Graz, Austria.
  • Department of Emergency Medicine, Inselspital University Hospital, University of Bern, Bern, Switzerland.

ORCID profiles: Anke Sabine Baetzner, Yannick Hill, Benjamin Roszipal, Solène Gerwann, Matthias Beutel, Tanja Birrenbach, Markus Karlseder, Stefan Mohr, Gabriel Alexander Salg, Helmut Schrom-Feiertag, Marie Ottilie Frenkel, Cornelia Wrzus

Cite

APA

Baetzner, A. S., Hill, Y., Roszipal, B., Gerwann, S., Beutel, M., Birrenbach, T., Karlseder, M., Mohr, S., Salg, G. A., Schrom-Feiertag, H., Frenkel, M. O., & Wrzus, C. (2025). Mass Casualty Incident Training in Immersive Virtual Reality: Quasi-Experimental Evaluation of Multimethod Performance Indicators. Journal of Medical Internet Research, 27, e63241. https://doi.org/10.2196/63241

Vancouver

Baetzner AS, Hill Y, Roszipal B, Gerwann S, Beutel M, Birrenbach T, et al. Mass Casualty Incident Training in Immersive Virtual Reality: Quasi-Experimental Evaluation of Multimethod Performance Indicators. Journal of Medical Internet Research. 2025;27:e63241. doi:10.2196/63241

BibTeX
@article{Baetzner2025,
  author = {Baetzner, Anke Sabine and Hill, Yannick and Roszipal, Benjamin and Gerwann, Solène and Beutel, Matthias and Birrenbach, Tanja and Karlseder, Markus and Mohr, Stefan and Salg, Gabriel Alexander and Schrom-Feiertag, Helmut and Frenkel, Marie Ottilie and Wrzus, Cornelia},
  title = {Mass Casualty Incident Training in Immersive Virtual Reality: Quasi-Experimental Evaluation of Multimethod Performance Indicators},
  journal = {Journal of Medical Internet Research},
  year = {2025},
  volume = {27},
  pages = {e63241},
  doi = {10.2196/63241}
}
Start for free →