EUVIMEDEUVIMED entdecken
ValidierungsstudieMixed-Methods-StudieOpen Access

Validity evaluation of a mock examination including multimedia-assisted items for the Korean Nursing Licensing Examination: a mixed-methods study with a counterbalanced design

Sujin Shin, Inyoung Lee, Heejeong Kim, Rhayun Song, Jun-Ah Song, Hyun Sook Yi, Janghee Park, Mi Kyoung Yim, Minjae Lee, Subin Yu

Journal of Educational Evaluation for Health Professions · 2026

DOI: 10.3352/jeehp.2026.23.21 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift Journal of Educational Evaluation for Health Professions, 2026. Verfasst von Sujin Shin und 9 weiteren Autor:innen. Beteiligte Einrichtung: College of Nursing, Ewha Womans University, Seoul, Korea. Hauptthemen laut MEDLINE: Multimedia, Educational Measurement, Students, Nursing, Licensure, Nursing. Die Arbeit nennt 15 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: Korea Health Personnel Licensing Examination Institute.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

This study aimed to evaluate the validity of multimedia-assisted items (MAIs) in a mock examination by examining their psychometric properties and nursing students’ perceptions.

Methods

This methodological study used a within-group counterbalanced design in which fourth-year nursing students in South Korea completed an online mock examination consisting of paired text-based items and MAIs. Psychometric properties were examined using classical test theory and item response theory, and learner perceptions and response processes were explored through post-examination surveys and focus group interviews.

Results

Among 515 participants, MAIs demonstrated overall difficulty and discrimination comparable to those of text-based items in both classical test theory and item response theory analyses, supporting measurement equivalence across item formats. Post-test surveys indicated that participants perceived MAIs as realistic reflections of clinical practice and as more helpful for problem solving and ability assessment than text-based items. Qualitative findings from focus group interviews (n=15) further supported the educational value of MAIs for assessing clinical judgment while emphasizing the need for appropriate multimedia use. An order effect was also observed: presenting text-based items first led to higher item response theory discrimination parameters in subsequent MAIs (P=0.020).

Conclusion

MAIs demonstrated psychometric properties comparable to those of text-based items and were positively perceived as valid tools for assessing clinical judgment and practical competence. These findings support the feasibility of incorporating multimedia-based assessment into the Korean Nursing Licensing Examination as part of a rigorous computer-based testing framework.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

MultimediaEducational MeasurementStudents, NursingLicensure, NursingHumansRepublic of KoreaPsychometricsFocus GroupsFemaleReproducibility of ResultsMaleEducation, Nursing, BaccalaureateAdultYoung AdultSurveys and Questionnaires

Stichwörter der Autor:innen

Educational measurementMultimediaNursing educationNursing licensurePsychometricsRepublic of Korea

Autor:innen und Institutionen

  • College of Nursing, Ewha Womans University, Seoul, Korea.
  • Department of Nursing, Dongnam Health University, Suwon, Korea. inylee@dongnam.ac.kr.
  • Division of Health Science, Department of Nursing Science, Baekseok University, Cheonan, Korea.
  • College of Nursing, Chungnam National University, Daejeon, Korea.
  • College of Nursing, Korea University, Seoul, Korea.
  • Department of Education, Konkuk University, Seoul, Korea.

Förderung

  • Korea Health Personnel Licensing Examination Institute

Zitieren

APA

Shin, S., Lee, I., Kim, H., Song, R., Song, J. A., Yi, H. S., Park, J., Yim, M. K., Lee, M., & Yu, S. (2026). Validity evaluation of a mock examination including multimedia-assisted items for the Korean Nursing Licensing Examination: a mixed-methods study with a counterbalanced design. Journal of Educational Evaluation for Health Professions. https://doi.org/10.3352/jeehp.2026.23.21

Vancouver

Shin S, Lee I, Kim H, Song R, Song JA, Yi HS, et al. Validity evaluation of a mock examination including multimedia-assisted items for the Korean Nursing Licensing Examination: a mixed-methods study with a counterbalanced design. Journal of Educational Evaluation for Health Professions. 2026. doi:10.3352/jeehp.2026.23.21

BibTeX
@article{Shin2026,
  author = {Shin, Sujin and Lee, Inyoung and Kim, Heejeong and Song, Rhayun and Song, Jun-Ah and Yi, Hyun Sook and Park, Janghee and Yim, Mi Kyoung and Lee, Minjae and Yu, Subin},
  title = {Validity evaluation of a mock examination including multimedia-assisted items for the Korean Nursing Licensing Examination: a mixed-methods study with a counterbalanced design},
  journal = {Journal of Educational Evaluation for Health Professions},
  year = {2026},
  doi = {10.3352/jeehp.2026.23.21}
}
Kostenlos starten →