Predicting undergraduate OSCE performance using traditional and construct-driven situational judgment tests at admission
Advances in Health Sciences Education · 2025
DOI: 10.1007/s10459-024-10379-3 ↗Kurz gefasst
Fachartikel in der Zeitschrift Advances in Health Sciences Education, 2025. Verfasst von Ina Mielke und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biochemistry and Molecular Cell Biology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany. i.mielke@uke.de. Hauptthemen laut MEDLINE: Judgment, Educational Measurement, Education, Medical, Undergraduate, School Admission Criteria. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Universitätsklinikum Hamburg-Eppendorf (UKE).
Abstract (Originalsprache)
Situational Judgement Tests (SJTs) are popular to screen for social skills during undergraduate medical admission as they have been shown to predict relevant study outcomes. Two different types of SJTs can be distinguished: Traditional SJTs, which measure general effective behavior, and construct-driven SJTs which are designed to measure specific constructs. To date, there has been no comparison of the predictive validity of these two types of SJTs in medical admission. With the present research, we examine whether the HAM-SJT, a traditional SJT, and the CD-SJT, a construct-driven SJT with an agentic and a communal scale, administered during undergraduate medical admission can predict OSCE (i.e., objective structured clinical examination) performance in a low-stakes ( n LS = 159) and a high-stakes ( n HS = 160) sample of medical students. Results showed a moderate positive relation between the communal scale of the CD-SJT and performance in OSCE stations with trained patients in the high-stakes sample ( r =.20, p =.009). This SJT had also an incremental value in predicting the OSCE performance above and beyond GPA (i.e., grade point average), a science test (i.e., HAM-Nat), and gender ( ß = 0.18, 95% CI [0.03; 0.33], p =.020). That is, individuals who chose more communal behavioral responses in the SJT were rated more favorably in interactions with trained patients in the OSCE. A comparable correlation coefficient was observed for the HAM-SJT when controlling for range restriction due to admission ( r raw = 0.14 vs. r controlled = 0.20). Our research provides a first indication for the predictive validity of construct-driven SJTs in high-stakes undergraduate medical admission.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biochemistry and Molecular Cell Biology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany. i.mielke@uke.de.
- Department of Psychology, University of Münster, Münster, Germany.
- Department of Biochemistry and Molecular Cell Biology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
- Department of General Practice/Primary Care, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
ORCID-Profile: Ina Mielke, Simon M Breil, Mirjana Knorr
Förderung
- Universitätsklinikum Hamburg-Eppendorf (UKE)
Zitieren
APA
Mielke, I., Breil, S. M., Hissbach, J., Ehrhardt, M., & Knorr, M. (2025). Predicting undergraduate OSCE performance using traditional and construct-driven situational judgment tests at admission. Advances in Health Sciences Education. https://doi.org/10.1007/s10459-024-10379-3
Vancouver
Mielke I, Breil SM, Hissbach J, Ehrhardt M, Knorr M. Predicting undergraduate OSCE performance using traditional and construct-driven situational judgment tests at admission. Advances in Health Sciences Education. 2025. doi:10.1007/s10459-024-10379-3
BibTeX
@article{Mielke2025,
author = {Mielke, Ina and Breil, Simon M and Hissbach, Johanna and Ehrhardt, Maren and Knorr, Mirjana},
title = {Predicting undergraduate OSCE performance using traditional and construct-driven situational judgment tests at admission},
journal = {Advances in Health Sciences Education},
year = {2025},
doi = {10.1007/s10459-024-10379-3}
}
EUVIMED