EUVIMEDEUVIMED entdecken
Crossref

Gathering Validity Evidence for the Bushmaster Assessment Tool

Ethan Elkins, Yen Lee, Ting Dong, Steven J Durning iD, Erin S Barry iD

Military Medicine · 2025

DOI: 10.1093/milmed/usae549 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Military Medicine, 2025. Verfasst von Ethan Elkins und 4 weiteren Autor:innen. Beteiligte Einrichtung: F. Edward Hébert School of Medicine, Uniformed Services University, Bethesda, MD 20814, USA. Hauptthemen laut MEDLINE: Educational Measurement, Psychometrics, Military Medicine. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 40 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

The education of military medical providers typically relies on assessments with established passing parameters to help ensure individuals are equipped to care for those in harm’s way. Evaluations of medical knowledge are often provided by governing bodies and are supported by strong validity evidence. In contrast, assessing an individual’s leadership skills presents a challenge, as tools with robust validity evidence for leadership evaluation are not yet as widely available as clinical assessment tools. This challenge becomes even more complex in simulated environments designed to mimic intense operational conditions. Materials and Methods An instrument has been implemented to assess students explicitly in a variety of graded roles with varying responsibilities. Faculty rate each student on their character, context, leadership-transcendent skills, communication, and competence using a 4-point Likert scale. This project used confirmatory factor analyses to assess the validity evidence of the instrument used during Bushmaster with data gathered from 645 School of Medicine students and 170 faculty evaluators from 2021 to 2023 resulting in 2863 evaluations.

Results

Overall, the one-factor structure was confirmed with Tucker Lewis Index >0.95, Root Mean Square Error of Approximation <0.03, and Standardized Root Mean Square Residual <0.03; student or faculty assessment had a small effect on item scores (interclass correlation <0.19) while the assigned position significantly affected the item score. The evaluation score of behavioral health officer and platoon leader was higher than the evaluation score of surgeon.

Conclusions

This study provides validity evidence for the Bushmaster leader assessment tool, confirming its ability to measure leader performance in military medical education. The findings highlight the importance of standardized faculty training in ensuring consistent evaluations, as variations in scores were influenced more by evaluation conditions than by differences among students or evaluators.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Educational MeasurementPsychometricsMilitary MedicineHumansLeadershipSurveys and QuestionnairesReproducibility of ResultsClinical CompetenceMaleFemaleFactor Analysis, StatisticalMilitary Personnel

Autor:innen und Institutionen

  • F. Edward Hébert School of Medicine, Uniformed Services University, Bethesda, MD 20814, USA.
  • Department of Health Professions Education, F. Edward Hébert School of Medicine, Uniformed Services University, Bethesda, MD 20814, USA.
  • Department of Anesthesiology, F. Edward Hébert School of Medicine, Uniformed Services University, Bethesda, MD 20814, USA.

ORCID-Profile: Steven J Durning, Erin S Barry

Zitieren

APA

Elkins, E., Lee, Y., Dong, T., Durning, S. J., & Barry, E. S. (2025). Gathering Validity Evidence for the Bushmaster Assessment Tool. Military Medicine. https://doi.org/10.1093/milmed/usae549

Vancouver

Elkins E, Lee Y, Dong T, Durning SJ, Barry ES. Gathering Validity Evidence for the Bushmaster Assessment Tool. Military Medicine. 2025. doi:10.1093/milmed/usae549

BibTeX
@article{Elkins2025,
  author = {Elkins, Ethan and Lee, Yen and Dong, Ting and Durning, Steven J and Barry, Erin S},
  title = {Gathering Validity Evidence for the Bushmaster Assessment Tool},
  journal = {Military Medicine},
  year = {2025},
  doi = {10.1093/milmed/usae549}
}
Kostenlos starten →