Gathering Validity Evidence for the Bushmaster Assessment Tool
Military Medicine · 2025
DOI: 10.1093/milmed/usae549 ↗Kurz gefasst
Fachartikel in der Zeitschrift Military Medicine, 2025. Verfasst von Ethan Elkins und 4 weiteren Autor:innen. Beteiligte Einrichtung: F. Edward Hébert School of Medicine, Uniformed Services University, Bethesda, MD 20814, USA. Hauptthemen laut MEDLINE: Educational Measurement, Psychometrics, Military Medicine. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 40 Literaturangaben.
Abstract (Originalsprache)
Introduction
The education of military medical providers typically relies on assessments with established passing parameters to help ensure individuals are equipped to care for those in harm’s way. Evaluations of medical knowledge are often provided by governing bodies and are supported by strong validity evidence. In contrast, assessing an individual’s leadership skills presents a challenge, as tools with robust validity evidence for leadership evaluation are not yet as widely available as clinical assessment tools. This challenge becomes even more complex in simulated environments designed to mimic intense operational conditions. Materials and Methods An instrument has been implemented to assess students explicitly in a variety of graded roles with varying responsibilities. Faculty rate each student on their character, context, leadership-transcendent skills, communication, and competence using a 4-point Likert scale. This project used confirmatory factor analyses to assess the validity evidence of the instrument used during Bushmaster with data gathered from 645 School of Medicine students and 170 faculty evaluators from 2021 to 2023 resulting in 2863 evaluations.
Results
Overall, the one-factor structure was confirmed with Tucker Lewis Index >0.95, Root Mean Square Error of Approximation <0.03, and Standardized Root Mean Square Residual <0.03; student or faculty assessment had a small effect on item scores (interclass correlation <0.19) while the assigned position significantly affected the item score. The evaluation score of behavioral health officer and platoon leader was higher than the evaluation score of surgeon.
Conclusions
This study provides validity evidence for the Bushmaster leader assessment tool, confirming its ability to measure leader performance in military medical education. The findings highlight the importance of standardized faculty training in ensuring consistent evaluations, as variations in scores were influenced more by evaluation conditions than by differences among students or evaluators.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- F. Edward Hébert School of Medicine, Uniformed Services University, Bethesda, MD 20814, USA.
- Department of Health Professions Education, F. Edward Hébert School of Medicine, Uniformed Services University, Bethesda, MD 20814, USA.
- Department of Anesthesiology, F. Edward Hébert School of Medicine, Uniformed Services University, Bethesda, MD 20814, USA.
ORCID-Profile: Steven J Durning, Erin S Barry
Zitieren
APA
Elkins, E., Lee, Y., Dong, T., Durning, S. J., & Barry, E. S. (2025). Gathering Validity Evidence for the Bushmaster Assessment Tool. Military Medicine. https://doi.org/10.1093/milmed/usae549
Vancouver
Elkins E, Lee Y, Dong T, Durning SJ, Barry ES. Gathering Validity Evidence for the Bushmaster Assessment Tool. Military Medicine. 2025. doi:10.1093/milmed/usae549
BibTeX
@article{Elkins2025,
author = {Elkins, Ethan and Lee, Yen and Dong, Ting and Durning, Steven J and Barry, Erin S},
title = {Gathering Validity Evidence for the Bushmaster Assessment Tool},
journal = {Military Medicine},
year = {2025},
doi = {10.1093/milmed/usae549}
}
EUVIMED