Validating the virtual: a deep dive into ultrasound simulator metrics in otorhinolaryngology
European Archives of Oto-Rhino-Laryngology · 2024-04 · 281 (4) · 1905-1911
DOI: 10.1007/s00405-023-08421-y ↗Kurz gefasst
Fachartikel in der Zeitschrift European Archives of Oto-Rhino-Laryngology, online erschienen am 04.01.2024. Verfasst von Anne Line Risgaard und 4 weiteren Autor:innen. Beteiligte Einrichtung: NordSim, Centre for Skills Training and Simulation, Aalborg University Hospital, Aalborg, Denmark. Hauptthemen laut MEDLINE: Clinical Competence, Virtual Reality. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Aalborg University Hospital.
Abstract (Originalsprache)
Purpose
This study aimed to assess the validity of simulation-based assessment of ultrasound skills for thyroid ultrasound.
Methods
The study collected validity evidence for simulation-based ultrasound assessment of thyroid ultrasound skills. Experts ( n = 8) and novices ( n = 21) completed a test containing two tasks and four cases on a virtual reality ultrasound simulator (U/S Mentor's Neck Ultrasound Module). Validity evidence was collected and structured according to Messick’s validity framework. The assessments being evaluated included built-in simulator metrics and expert-based evaluations using the Objective Structured Assessment of Ultrasound Skills (OSAUS) scale.
Results
Out of 64 built-in simulator metrics, 9 (14.1%) exhibited validity evidence. The internal consistency of these metrics was strong (Cronbach’s α = 0.805) with high test–retest reliability (intraclass correlation coefficient = 0.911). Novices achieved an average score of 41.9% (SD = 24.3) of the maximum, contrasting with experts at 81.9% (SD = 16.7). Time comparisons indicated minor differences between experts (median: 359 s) and novices (median: 376.5 s). All OSAUS items differed significantly between the two groups. The correlation between correctly entered clinical findings and the OSAUS scores was 0.748 ( p < 0.001). The correlation between correctly entered clinical findings and the metric scores was 0.801 ( p < 0.001).
Conclusion
While simulation-based training is promising, only 14% of built-in simulator metrics could discriminate between novices and ultrasound experts. Already-established competency frameworks such as OSAUS provided strong validity evidence for the assessment of otorhinolaryngology ultrasound competence.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- NordSim, Centre for Skills Training and Simulation, Aalborg University Hospital, Aalborg, Denmark.
- Department of Otorhinolaryngology - Head and Neck Surgery, Aalborg University Hospital, Aalborg, Denmark.
- NordSim, Centre for Skills Training and Simulation, Aalborg University Hospital, Aalborg, Denmark. iben.a@rn.dk.
- Department of Otorhinolaryngology - Head and Neck Surgery, Aalborg University Hospital, Aalborg, Denmark. iben.a@rn.dk.
- Department of Clinical Medicine, Aalborg University, Aalborg, Denmark.
- Copenhagen Academy for Medical Education and Simulation (CAMES) Rigshospitalet and Center for Fetal Medicine, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark.
Förderung
- Aalborg University Hospital
Zitieren
APA
Risgaard, A. L., Andersen, I. B., Friis, M. L., Tolsgaard, M. G., & Danstrup, C. S. (2024). Validating the virtual: a deep dive into ultrasound simulator metrics in otorhinolaryngology. European Archives of Oto-Rhino-Laryngology, 281(4), 1905-1911. https://doi.org/10.1007/s00405-023-08421-y
Vancouver
Risgaard AL, Andersen IB, Friis ML, Tolsgaard MG, Danstrup CS. Validating the virtual: a deep dive into ultrasound simulator metrics in otorhinolaryngology. European Archives of Oto-Rhino-Laryngology. 2024;281(4):1905-1911. doi:10.1007/s00405-023-08421-y
BibTeX
@article{Risgaard2024,
author = {Risgaard, Anne Line and Andersen, Iben Bang and Friis, Mikkel Lønborg and Tolsgaard, Martin Grønnebæk and Danstrup, Christian Sander},
title = {Validating the virtual: a deep dive into ultrasound simulator metrics in otorhinolaryngology},
journal = {European Archives of Oto-Rhino-Laryngology},
year = {2024},
volume = {281},
number = {4},
pages = {1905--1911},
doi = {10.1007/s00405-023-08421-y}
}
EUVIMED