Multifaceted validity analysis of clinical skills test in the educational field setting
Journal of Korean Medicine · 01.03.2024 · 45 (1) · 1-16
DOI: 10.13048/jkm.24001 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Korean Medicine, online erschienen am 01.03.2024. Verfasst von Han Chae und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 3.0). Gefördert von: Pusan National University.
Abstract (Originalsprache)
Introduction
The importance of clinical skills training in traditional Korean medicine education is increasingly emphasized. Since the clinical skills tests are high-stakes tests that determine success in national licensing exams, it is essential to develop reliable multifaceted analysis methods for clinical skills tests in actual education settings. In this study, we applied the multifaceted validity evaluation methods to the evaluation results of the cardiopulmonary resuscitation module to confirm the applicability and effectiveness of the methods.
Methods
In this study, we used internal consistency, factor analysis, generalizability theory G-study and D-study, ANOVA, Kendall's tau, descriptive statistics, and other statistical methods to analyze the multidimensional validity of a cardiopulmonary resuscitation test in clinical education settings over the past three years.
Results
The factor analysis and internal consistency analysis showed that the evaluation rubric had an unstable structure and low concordance. The G-study showed that the error of the clinical skills assessment was large due to the evaluator and unexpected errors. The D-study showed that the variance error of the evaluator should be significantly reduced to validate the evaluation. The ANOVA and Kendall's tau confirmed that evaluator heterogeneity was a problem.Discussion and Conclusion: Clinical skills tests should be continuously evaluated and managed for validity in two steps of pre-production and actual implementation. This study has presented specific methods for analyzing the validity of clinical skills training and testing in actual education settings. This study would contribute to the foundation for competency-based evidence-based education in practical clinical training.
Förderung
- Pusan National University
Zitieren
APA
Chae, H., Lee, M., Kim, M., Kim, K., & Cho, E. (2024). Multifaceted validity analysis of clinical skills test in the educational field setting. Journal of Korean Medicine, 45(1), 1-16. https://doi.org/10.13048/jkm.24001
Vancouver
Chae H, Lee M, Kim M, Kim K, Cho E. Multifaceted validity analysis of clinical skills test in the educational field setting. Journal of Korean Medicine. 2024;45(1):1-16. doi:10.13048/jkm.24001
BibTeX
@article{Chae2024,
author = {Chae, Han and Lee, Min-jung and Kim, Myung-Ho and Kim, Kyuseok and Cho, Eunbyul},
title = {Multifaceted validity analysis of clinical skills test in the educational field setting},
journal = {Journal of Korean Medicine},
year = {2024},
volume = {45},
number = {1},
pages = {1--16},
doi = {10.13048/jkm.24001}
}
EUVIMED