EUVIMEDEUVIMED entdecken
Randomisierte kontrollierte StudieOpen Access · CC BY 4.0

Use of very short answer questions compared to multiple choice questions in undergraduate medical students: An external validation study

Elise V van Wijk iD, Roemer J Janse, Bastian N Ruijter, Jos H T Rohling iD, Jolein van der Kraan, Stijn Crobach, Mario de Jonge, Arnout Jan de Beaufort, Friedo W Dekker, Alexandra M J Langers iD

PLOS ONE · 14.07.2023 · 18 (7) · e0288558

DOI: 10.1371/journal.pone.0288558 ↗

Kurz gefasst

Randomisierte kontrollierte Studie in der Zeitschrift PLOS ONE, online erschienen am 14.07.2023. Verfasst von Elise V van Wijk und 9 weiteren Autor:innen. Beteiligte Einrichtung: Center for Innovation in Medical Education, Leiden University Medical Center, Leiden, The Netherlands. Hauptthemen laut MEDLINE: Students, Medical, Education, Medical, Undergraduate, Education, Medical. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multiple choice questions (MCQs) offer high reliability and easy machine-marking, but allow for cueing and stimulate recognition-based learning. Very short answer questions (VSAQs), which are open-ended questions requiring a very short answer, may circumvent these limitations. Although VSAQ use in medical assessment increases, almost all research on reliability and validity of VSAQs in medical education has been performed by a single research group with extensive experience in the development of VSAQs. Therefore, we aimed to validate previous findings about VSAQ reliability, discrimination, and acceptability in undergraduate medical students and teachers with limited experience in VSAQs development. To validate the results presented in previous studies, we partially replicated a previous study and extended results on student experiences. Dutch undergraduate medical students (n = 375) were randomized to VSAQs first and MCQs second or vice versa in a formative exam in two courses, to determine reliability, discrimination, and cueing. Acceptability for teachers (i.e., VSAQ review time) was determined in the summative exam. Reliability (Cronbach’s α) was 0.74 for VSAQs and 0.57 for MCQs in one course. In the other course, Cronbach’s α was 0.87 for VSAQs and 0.83 for MCQs. Discrimination (average R ir ) was 0.27 vs. 0.17 and 0.43 vs. 0.39 for VSAQs vs. MCQs, respectively. Reviewing time of one VSAQ for the entire student cohort was ±2 minutes on average. Positive cueing occurred more in MCQs than in VSAQs (20% vs. 4% and 20.8% vs. 8.3% of questions per person in both courses). This study validates the positive results regarding VSAQs reliability, discrimination, and acceptability in undergraduate medical students. Furthermore, we demonstrate that VSAQ use is reliable among teachers with limited experience in writing and marking VSAQs. The short learning curve for teachers, favourable marking time and applicability regardless of the topic suggest that VSAQs might also be valuable beyond medical assessment.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Students, MedicalEducation, Medical, UndergraduateEducation, MedicalHumansReproducibility of ResultsEducational Measurement

Autor:innen und Institutionen

  • Center for Innovation in Medical Education, Leiden University Medical Center, Leiden, The Netherlands.
  • Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands.
  • Department of Gastroenterology and Hepatology, Leiden University Medical Center, Leiden, The Netherlands.
  • Department of Cell and Chemical Biology, Leiden University Medical Center, Leiden, The Netherlands.
  • Department of Pathology, Leiden University Medical Center, Leiden, The Netherlands.
  • Leiden University Graduate School of Teaching, Leiden University, Leiden, The Netherlands.

ORCID-Profile: Elise V van Wijk, Jos H T Rohling, Alexandra M J Langers

Zitieren

APA

van Wijk, E. V., Janse, R. J., Ruijter, B. N., Rohling, J. H. T., van der Kraan, J., Crobach, S., Jonge, M., Beaufort, A. J., Dekker, F. W., & Langers, A. M. J. (2023). Use of very short answer questions compared to multiple choice questions in undergraduate medical students: An external validation study. PLOS ONE, 18(7), e0288558. https://doi.org/10.1371/journal.pone.0288558

Vancouver

van Wijk EV, Janse RJ, Ruijter BN, Rohling JHT, van der Kraan J, Crobach S, et al. Use of very short answer questions compared to multiple choice questions in undergraduate medical students: An external validation study. PLOS ONE. 2023;18(7):e0288558. doi:10.1371/journal.pone.0288558

BibTeX
@article{vanWijk2023,
  author = {van Wijk, Elise V and Janse, Roemer J and Ruijter, Bastian N and Rohling, Jos H T and van der Kraan, Jolein and Crobach, Stijn and Jonge, Mario de and Beaufort, Arnout Jan de and Dekker, Friedo W and Langers, Alexandra M J},
  title = {Use of very short answer questions compared to multiple choice questions in undergraduate medical students: An external validation study},
  journal = {PLOS ONE},
  year = {2023},
  volume = {18},
  number = {7},
  pages = {e0288558},
  doi = {10.1371/journal.pone.0288558}
}
Kostenlos starten →