Item Analysis of Multiple Choice and Extended Matching Questions in the Final MBBS Medicine and Therapeutics Examination
Journal of Medical Education · 2022
DOI: 10.5812/jme-129450 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Medical Education, 2022. Verfasst von Alok Kumar und 11 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Background
Most universities around the world use the multiple-choice question (MCQ) examination format to evaluate medical education. However, the suitability and advantages of traditional MCQs and extended matching questions (EMQs) continue to be debated.
Objectives
This study mainly aimed to perform a comprehensive comparative analysis of the performance of the EMQ and traditional MCQ formats in the final MBBS exit examination.
Methods
We conducted an item analysis of 80 EMQs, and 200 MCQs administered to 532 examinees across the four campuses of the University of the West Indies during the final MBBS medicine and therapeutics examination of 2019. Exam performance measures included central tendency, item discrimination, reliability, item difficulty, and distractor efficacy.
Results
For the 532 students who sat the exam, the highest, lowest, and mean (± SD) scores for the EMQs were 93, 41, and 69.0 (± 9.8), respectively; for the MCQs, the respective values were 82, 41, and 62.7 (± 7.4). The predictive value of the EMQ and MCQ grades individually in the overall failure was 0.67 (95% CI = 0.39, 0.87) and 0.89 (95% CI = 0.65, 0.98), respectively. KR-20 coefficients for the EMQs and MCQs ranged from 0.52 to 0.70 and 0.71 to 0.79, respectively. The proportion of questions with two or more functional distractors was consistently higher for the MCQs than for the EMQs in all four cohorts of students.
Conclusions
The MCQs were more predictive of the overall failure and had higher inter-item reliability, making the MCQ format more suitable for high-stakes examinations.
Zitieren
APA
Kumar, A., George, C., Campbell, M. H., Krishnamurthy, K., Lashley, P. M., Singh, V., Motilal, S., Sakhamuri, S., Thompson, T., SinQuee-Brown, C., Sa, B., & Majumder, M. A. A. (2022). Item Analysis of Multiple Choice and Extended Matching Questions in the Final MBBS Medicine and Therapeutics Examination. Journal of Medical Education. https://doi.org/10.5812/jme-129450
Vancouver
Kumar A, George C, Campbell MH, Krishnamurthy K, Lashley PM, Singh V, et al. Item Analysis of Multiple Choice and Extended Matching Questions in the Final MBBS Medicine and Therapeutics Examination. Journal of Medical Education. 2022. doi:10.5812/jme-129450
BibTeX
@article{Kumar2022,
author = {Kumar, Alok and George, Colette and Campbell, Michael Harry and Krishnamurthy, Kandamaran and Lashley, Paula Michele and Singh, Virendra and Motilal, Shastri and Sakhamuri, Sateesh and Thompson, Tamara and SinQuee-Brown, Corrine and Sa, Bidyadhar and Majumder, Md Anwarul Azim},
title = {Item Analysis of Multiple Choice and Extended Matching Questions in the Final MBBS Medicine and Therapeutics Examination},
journal = {Journal of Medical Education},
year = {2022},
doi = {10.5812/jme-129450}
}
EUVIMED