The validity of selection assessments for medical specialty selection: examining prediction across different training outcomes
Postgraduate Medical Journal · 23.09.2026 · 102 (1212) · 899-908
DOI: 10.1093/postmj/qgag054 ↗Kurz gefasst
Fachartikel in der Zeitschrift Postgraduate Medical Journal, online erschienen am 13.05.2026. Verfasst von Emma Morley und 3 weiteren Autor:innen. Beteiligte Einrichtung: Work Psychology Group, Cubo Derby, Victoria Street, Derby, DE1 1EQ, United Kingdom. Hauptthemen laut MEDLINE: School Admission Criteria, Clinical Competence, Educational Measurement, Education, Medical, Graduate. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 15 Literaturangaben. Gefördert von: NHS England, Department of Health and Social Care.
Abstract (Originalsprache)
Purpose of the study The Multi-Specialty Recruitment Assessment (MSRA) is a proctored assessment, comprising a clinical problem-solving (CPS) test and a situational judgement test (SJT), often combined with selection interviews, for admission to multiple postgraduate medical specialty training programmes in the UK. The study examined the predictive validity of these selection assessments (i.e. the extent to which they effectively predicted later performance outcomes). Study design Data were obtained from the UKMED dataset and analyzed for ten UK medical specialties (~13 000 unique applications) to explore relationships between selection data (CPS, SJT, and selection interview) and subsequent performance outcomes; Annual Review of Competence Progression (ARCP) and national professional examination scores, comprising Applied Knowledge Tests (AKTs) and Objective Structured Clinical Examinations (OSCEs).
Results
Results supported the predictive validity of the MSRA and interview scores with some evident trends across different criteria. For example, the CPS tended to be most predictive of the AKT performance, and the SJT (which assesses non-academic skills) tended to be more strongly predictive of OSCE than AKT performance. The predictive validity of the selection interviews beyond the MSRA varied by specialty.
Conclusion
Results provide evidence of the predictive validity for both the MSRA and interviews across a range of specialties, providing insights into how best to design and combine different selection methods to balance key considerations such as reliability, validity, efficiency, and positive candidate feedback. The findings of this research also have implications for other healthcare selection settings. Key messages • What is already known on this topic – Previous research has already demonstrated that the MSRA shows predictive validity in the context of General Practice and Psychiatry selection, and has begun to explore the validity of the MSRA and interviews in further specialties. However, there is a lack of recent research exploring the predictive validity of MSRA in selection processes across other specialties, using a range of criterion measures and longitudinal performance outcomes, such as exam data. • What this study adds – The MSRA demonstrates validity with Annual Review of Competence Progression (ARCP) and national professional examination scores in postgraduate medical specialty training, across a range of different medical specialties. • How this study might affect research, practice, or policy – The results of this study can be used to inform future policy and decision making regarding the use of the MSRA alongside selection interviews and to enhance the reliability, validity, efficiency, and candidate experience for selection in future. Further, results provide valuable insights about the validity of such methods which may be informative to other settings internationally.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Work Psychology Group, Cubo Derby, Victoria Street, Derby, DE1 1EQ, United Kingdom.
- Surrey Business School, University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
- Howcroft Crescent, London, N3, United Kingdom.
ORCID-Profile: Emma Morley
Förderung
- NHS England
- Department of Health and Social Care
Zitieren
APA
Morley, E., Woods, S. A., Baron, H., & Patterson, F. (2026). The validity of selection assessments for medical specialty selection: examining prediction across different training outcomes. Postgraduate Medical Journal, 102(1212), 899-908. https://doi.org/10.1093/postmj/qgag054
Vancouver
Morley E, Woods SA, Baron H, Patterson F. The validity of selection assessments for medical specialty selection: examining prediction across different training outcomes. Postgraduate Medical Journal. 2026;102(1212):899-908. doi:10.1093/postmj/qgag054
BibTeX
@article{Morley2026,
author = {Morley, Emma and Woods, Stephen A and Baron, Helen and Patterson, Fiona},
title = {The validity of selection assessments for medical specialty selection: examining prediction across different training outcomes},
journal = {Postgraduate Medical Journal},
year = {2026},
volume = {102},
number = {1212},
pages = {899--908},
doi = {10.1093/postmj/qgag054}
}
EUVIMED