Validity evaluation of a mock examination including multimedia-assisted items for the Korean Nursing Licensing Examination: a mixed-methods study with a counterbalanced design
Journal of Educational Evaluation for Health Professions · 2026
DOI: 10.3352/jeehp.2026.23.21 ↗Kurz gefasst
Validierungsstudie in der Zeitschrift Journal of Educational Evaluation for Health Professions, 2026. Verfasst von Sujin Shin und 9 weiteren Autor:innen. Beteiligte Einrichtung: College of Nursing, Ewha Womans University, Seoul, Korea. Hauptthemen laut MEDLINE: Multimedia, Educational Measurement, Students, Nursing, Licensure, Nursing. Die Arbeit nennt 15 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: Korea Health Personnel Licensing Examination Institute.
Abstract (Originalsprache)
Purpose
This study aimed to evaluate the validity of multimedia-assisted items (MAIs) in a mock examination by examining their psychometric properties and nursing students’ perceptions.
Methods
This methodological study used a within-group counterbalanced design in which fourth-year nursing students in South Korea completed an online mock examination consisting of paired text-based items and MAIs. Psychometric properties were examined using classical test theory and item response theory, and learner perceptions and response processes were explored through post-examination surveys and focus group interviews.
Results
Among 515 participants, MAIs demonstrated overall difficulty and discrimination comparable to those of text-based items in both classical test theory and item response theory analyses, supporting measurement equivalence across item formats. Post-test surveys indicated that participants perceived MAIs as realistic reflections of clinical practice and as more helpful for problem solving and ability assessment than text-based items. Qualitative findings from focus group interviews (n=15) further supported the educational value of MAIs for assessing clinical judgment while emphasizing the need for appropriate multimedia use. An order effect was also observed: presenting text-based items first led to higher item response theory discrimination parameters in subsequent MAIs (P=0.020).
Conclusion
MAIs demonstrated psychometric properties comparable to those of text-based items and were positively perceived as valid tools for assessing clinical judgment and practical competence. These findings support the feasibility of incorporating multimedia-based assessment into the Korean Nursing Licensing Examination as part of a rigorous computer-based testing framework.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Nursing, Ewha Womans University, Seoul, Korea.
- Department of Nursing, Dongnam Health University, Suwon, Korea. inylee@dongnam.ac.kr.
- Division of Health Science, Department of Nursing Science, Baekseok University, Cheonan, Korea.
- College of Nursing, Chungnam National University, Daejeon, Korea.
- College of Nursing, Korea University, Seoul, Korea.
- Department of Education, Konkuk University, Seoul, Korea.
Förderung
- Korea Health Personnel Licensing Examination Institute
Zitieren
APA
Shin, S., Lee, I., Kim, H., Song, R., Song, J. A., Yi, H. S., Park, J., Yim, M. K., Lee, M., & Yu, S. (2026). Validity evaluation of a mock examination including multimedia-assisted items for the Korean Nursing Licensing Examination: a mixed-methods study with a counterbalanced design. Journal of Educational Evaluation for Health Professions. https://doi.org/10.3352/jeehp.2026.23.21
Vancouver
Shin S, Lee I, Kim H, Song R, Song JA, Yi HS, et al. Validity evaluation of a mock examination including multimedia-assisted items for the Korean Nursing Licensing Examination: a mixed-methods study with a counterbalanced design. Journal of Educational Evaluation for Health Professions. 2026. doi:10.3352/jeehp.2026.23.21
BibTeX
@article{Shin2026,
author = {Shin, Sujin and Lee, Inyoung and Kim, Heejeong and Song, Rhayun and Song, Jun-Ah and Yi, Hyun Sook and Park, Janghee and Yim, Mi Kyoung and Lee, Minjae and Yu, Subin},
title = {Validity evaluation of a mock examination including multimedia-assisted items for the Korean Nursing Licensing Examination: a mixed-methods study with a counterbalanced design},
journal = {Journal of Educational Evaluation for Health Professions},
year = {2026},
doi = {10.3352/jeehp.2026.23.21}
}
EUVIMED