Computer Adaptive vs. Non-adaptive Medical Progress Testing: Feasibility, Test Performance, and Student Experiences
Perspectives on Medical Education · 2024
DOI: 10.5334/pme.1345 ↗Kurz gefasst
Fachartikel in der Zeitschrift Perspectives on Medical Education, 2024. Verfasst von Elise V Van Wijk und 9 weiteren Autor:innen. Beteiligte Einrichtung: Center for Innovation in Medical Education, Leiden University Medical Center, the Netherlands. Hauptthemen laut MEDLINE: Educational Measurement, Students, Medical, Feasibility Studies. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Computerized adaptive testing tailors test items to students’ abilities by adapting difficulty level. This more efficient, and reliable assessment form may provide advantages over a conventional medical progress test (PT). Prior to our study, a direct comparison of students’ performance on a computer adaptive progress test (CA-PT) and a conventional PT, which is crucial for nationwide implementation of the CA-PT, was missing. Therefore, we assessed the correlation between CA-PT and conventional PT test performance and explored the feasibility and student experiences of CA-PT in a large medical cohort.
Methods
In this cross-over study medical students (n = 1432) of three Dutch medical schools participated in both a conventional PT and CA-PT. They were stratified to start with either a conventional PT or CA-PT to determine test performance. Student motivation, engagement and experiences were assessed by questionnaires in students from seven Dutch medical schools. Parallel-forms reliability was assessed using the Pearson correlation coefficient.
Results
A strong correlation was found (0.834) between conventional PT and CA-PT test performance. The CA-PT was administered without system performance issues and was completed in a median time of 83 minutes (67–102 minutes). Questionnaire response rate was 31.7% (526/1658). Despite a higher experienced difficulty, most students reported persistence, adequate task management and good focus during the CA-PT.
Conclusions
CA-PT provides a reliable estimation of students’ ability level in less time than a conventional non-adaptive PT and is feasible in students throughout the entire medical curriculum. Despite the strong correlation between PT scores, students found the CA-PT more challenging.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Center for Innovation in Medical Education, Leiden University Medical Center, the Netherlands.
- School of Health Professions Education, Faculty of Health, Medicine and Life Sciences, Maastricht University, the Netherlands.
- Department of Pediatrics, Erasmus Medical Center, Rotterdam, the Netherlands.
- Department of General Practice and Elderly Care Medicine, Amsterdam University Medical Center, Amsterdam, the Netherlands.
- Department of Neurology, University of Groningen, University Medical Center Groningen, Groningen, the Netherlands.
- Department of Physiology, Amsterdam University Medical Center, Amsterdam, the Netherlands.
ORCID-Profile: Elise V Van Wijk, Jeroen Donkers, Peter C J De Laat, Ariadne A Meiboom, Bram Jacobs, Jan Hindrik Ravesloot, René A Tio, Cees P M Van Der Vleuten, Alexandra M J Langers, Andre J A Bremers
Zitieren
APA
Van Wijk, E. V., Donkers, J., De Laat, P. C. J., Meiboom, A. A., Jacobs, B., Ravesloot, J. H., Tio, R. A., Van Der Vleuten, C. P. M., Langers, A. M. J., & Bremers, A. J. A. (2024). Computer Adaptive vs. Non-adaptive Medical Progress Testing: Feasibility, Test Performance, and Student Experiences. Perspectives on Medical Education. https://doi.org/10.5334/pme.1345
Vancouver
Van Wijk EV, Donkers J, De Laat PCJ, Meiboom AA, Jacobs B, Ravesloot JH, et al. Computer Adaptive vs. Non-adaptive Medical Progress Testing: Feasibility, Test Performance, and Student Experiences. Perspectives on Medical Education. 2024. doi:10.5334/pme.1345
BibTeX
@article{VanWijk2024,
author = {Van Wijk, Elise V and Donkers, Jeroen and De Laat, Peter C J and Meiboom, Ariadne A and Jacobs, Bram and Ravesloot, Jan Hindrik and Tio, René A and Van Der Vleuten, Cees P M and Langers, Alexandra M J and Bremers, Andre J A},
title = {Computer Adaptive vs. Non-adaptive Medical Progress Testing: Feasibility, Test Performance, and Student Experiences},
journal = {Perspectives on Medical Education},
year = {2024},
doi = {10.5334/pme.1345}
}
EUVIMED