EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Validity evidence for a team‐leading assessment tool in pediatric emergency resuscitations using video review

Victoria Hartwell iD, Katherine Edmunds iD, Laura Elliott, Brenda Williams, Paul T Menk, Gary L Geis

AEM Education and Training · 2024-06 · 8 (3)

DOI: 10.1002/aet2.10985 ↗

Kurz gefasst

Fachartikel in der Zeitschrift AEM Education and Training, online erschienen am 30.04.2024. Verfasst von Victoria Hartwell und 5 weiteren Autor:innen. Beteiligte Einrichtung: Division of Emergency Medicine Cincinnati Children's Hospital Medical Center Cincinnati Ohio USA. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Effective leadership of health care action teams has demonstrated positive influence on team performance and patient care, but there is no consensus on how to assess these skills. We developed a novel team leadership assessment tool for leaders of interprofessional pediatric resuscitation teams and collected validity evidence for this tool using video review.

Methods

This was a prospective cohort study from November 2021 to October 2022. A novel team leadership assessment tool was developed using literature review and local expertise and then piloted and refined using medical simulation. Pediatric emergency medicine (PEM) fellows from a single tertiary care pediatric medical center were enrolled, and videos of one medical resuscitation and one trauma resuscitation were collected per fellow each month. Three reviewers underwent reviewer training and then scored the videos using the assessment tool. Raters provided feedback on feasibility and ease of use using a 5‐point Likert scale. Inter‐rater reliability for the assessment tool using Gwet's agreement coefficient and the association between performance and clinical level of training using generalized linear mixed model were calculated.

Results

Twelve PEM fellows enrolled and 146 videos were reviewed. The inter‐rater reliability for each domain ranged from 0.45 ( p < 0.0001) to 0.59 ( p < 0.0001), with the inter‐rater reliability of the total score being 0.49 ( p < 0.0001). The reviewers’ mean ratings of the elements of the tool were as follows: clarity of the domains (4.6/5), the independence of each domain from each other (3.9/5), the ease of use of the 5‐point Likert scale (4.5/5), the usefulness of the provided examples for each domain (4.6/5), and the ability to assess each domain without having to rewatch (4.5/5). The tool differentiated between levels of clinical training for two of the six domains ( p < 0.02).

Conclusions

We developed a novel team leadership assessment tool for pediatric resuscitation team leaders that demonstrated moderate inter‐rater reliability. The tool was easy to use and feasible for educators to assess the performance of PEM trainees in complex high‐stakes clinical situations.

Autor:innen und Institutionen

  • Division of Emergency Medicine Cincinnati Children's Hospital Medical Center Cincinnati Ohio USA.
  • Department of Pediatrics University of Cincinnati College of Medicine Cincinnati Ohio USA.
  • Present address: PM Pediatrics New Hyde Park NY USA.
  • Center for Simulation and Research Cincinnati Children's Hospital Medical Center Cincinnati Ohio USA.
  • Cincinnati Children's Hospital Medical Center Cincinnati Ohio USA.
  • Present address: Pediatric Emergency Medicine, Children's Healthcare of Atlanta, and Department of Pediatrics, Emory University School of Medicine Atlanta GA USA.

ORCID-Profile: Victoria Hartwell, Katherine Edmunds

Zitieren

APA

Hartwell, V., Edmunds, K., Elliott, L., Williams, B., Menk, P. T., & Geis, G. L. (2024). Validity evidence for a team‐leading assessment tool in pediatric emergency resuscitations using video review. AEM Education and Training, 8(3). https://doi.org/10.1002/aet2.10985

Vancouver

Hartwell V, Edmunds K, Elliott L, Williams B, Menk PT, Geis GL. Validity evidence for a team‐leading assessment tool in pediatric emergency resuscitations using video review. AEM Education and Training. 2024;8(3). doi:10.1002/aet2.10985

BibTeX
@article{Hartwell2024,
  author = {Hartwell, Victoria and Edmunds, Katherine and Elliott, Laura and Williams, Brenda and Menk, Paul T and Geis, Gary L},
  title = {Validity evidence for a team‐leading assessment tool in pediatric emergency resuscitations using video review},
  journal = {AEM Education and Training},
  year = {2024},
  volume = {8},
  number = {3},
  doi = {10.1002/aet2.10985}
}
Kostenlos starten →