EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Validating the virtual: a deep dive into ultrasound simulator metrics in otorhinolaryngology

Anne Line Risgaard, Iben Bang Andersen, Mikkel Lønborg Friis, Martin Grønnebæk Tolsgaard, Christian Sander Danstrup

European Archives of Oto-Rhino-Laryngology · 2024-04 · 281 (4) · 1905-1911

DOI: 10.1007/s00405-023-08421-y ↗

Kurz gefasst

Fachartikel in der Zeitschrift European Archives of Oto-Rhino-Laryngology, online erschienen am 04.01.2024. Verfasst von Anne Line Risgaard und 4 weiteren Autor:innen. Beteiligte Einrichtung: NordSim, Centre for Skills Training and Simulation, Aalborg University Hospital, Aalborg, Denmark. Hauptthemen laut MEDLINE: Clinical Competence, Virtual Reality. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Aalborg University Hospital.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

This study aimed to assess the validity of simulation-based assessment of ultrasound skills for thyroid ultrasound.

Methods

The study collected validity evidence for simulation-based ultrasound assessment of thyroid ultrasound skills. Experts ( n = 8) and novices ( n = 21) completed a test containing two tasks and four cases on a virtual reality ultrasound simulator (U/S Mentor's Neck Ultrasound Module). Validity evidence was collected and structured according to Messick’s validity framework. The assessments being evaluated included built-in simulator metrics and expert-based evaluations using the Objective Structured Assessment of Ultrasound Skills (OSAUS) scale.

Results

Out of 64 built-in simulator metrics, 9 (14.1%) exhibited validity evidence. The internal consistency of these metrics was strong (Cronbach’s α = 0.805) with high test–retest reliability (intraclass correlation coefficient = 0.911). Novices achieved an average score of 41.9% (SD = 24.3) of the maximum, contrasting with experts at 81.9% (SD = 16.7). Time comparisons indicated minor differences between experts (median: 359 s) and novices (median: 376.5 s). All OSAUS items differed significantly between the two groups. The correlation between correctly entered clinical findings and the OSAUS scores was 0.748 ( p < 0.001). The correlation between correctly entered clinical findings and the metric scores was 0.801 ( p < 0.001).

Conclusion

While simulation-based training is promising, only 14% of built-in simulator metrics could discriminate between novices and ultrasound experts. Already-established competency frameworks such as OSAUS provided strong validity evidence for the assessment of otorhinolaryngology ultrasound competence.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Clinical CompetenceVirtual RealityHumansReproducibility of ResultsUltrasonographyComputer Simulation

Stichwörter der Autor:innen

Assessment of learningDiagnostic accuracyHead and neck ultrasoundSimulation-based medical educationUltrasonographyValidity evidence

Autor:innen und Institutionen

  • NordSim, Centre for Skills Training and Simulation, Aalborg University Hospital, Aalborg, Denmark.
  • Department of Otorhinolaryngology - Head and Neck Surgery, Aalborg University Hospital, Aalborg, Denmark.
  • NordSim, Centre for Skills Training and Simulation, Aalborg University Hospital, Aalborg, Denmark. iben.a@rn.dk.
  • Department of Otorhinolaryngology - Head and Neck Surgery, Aalborg University Hospital, Aalborg, Denmark. iben.a@rn.dk.
  • Department of Clinical Medicine, Aalborg University, Aalborg, Denmark.
  • Copenhagen Academy for Medical Education and Simulation (CAMES) Rigshospitalet and Center for Fetal Medicine, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark.

Förderung

  • Aalborg University Hospital

Zitieren

APA

Risgaard, A. L., Andersen, I. B., Friis, M. L., Tolsgaard, M. G., & Danstrup, C. S. (2024). Validating the virtual: a deep dive into ultrasound simulator metrics in otorhinolaryngology. European Archives of Oto-Rhino-Laryngology, 281(4), 1905-1911. https://doi.org/10.1007/s00405-023-08421-y

Vancouver

Risgaard AL, Andersen IB, Friis ML, Tolsgaard MG, Danstrup CS. Validating the virtual: a deep dive into ultrasound simulator metrics in otorhinolaryngology. European Archives of Oto-Rhino-Laryngology. 2024;281(4):1905-1911. doi:10.1007/s00405-023-08421-y

BibTeX
@article{Risgaard2024,
  author = {Risgaard, Anne Line and Andersen, Iben Bang and Friis, Mikkel Lønborg and Tolsgaard, Martin Grønnebæk and Danstrup, Christian Sander},
  title = {Validating the virtual: a deep dive into ultrasound simulator metrics in otorhinolaryngology},
  journal = {European Archives of Oto-Rhino-Laryngology},
  year = {2024},
  volume = {281},
  number = {4},
  pages = {1905--1911},
  doi = {10.1007/s00405-023-08421-y}
}
Kostenlos starten →