EUVIMEDEUVIMED entdecken
Scoping ReviewOpen Access · CC BY 4.0

Examiner training and calibration for simulated clinical examinations: A scoping review

Harish Thampy iD, Niamh Callanan, Arslan Ahmed, Sophia Taromsari

Medical Education · 2026-12 · 60 (12) · 1332-1349

DOI: 10.1111/medu.70253 ↗

Kurz gefasst

Scoping Review in der Zeitschrift Medical Education, online erschienen am 25.06.2026. Verfasst von Harish Thampy und 3 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Biology, Medicine and Health, University of Manchester, Manchester, UK. Hauptthemen laut MEDLINE: Clinical Competence, Educational Measurement, Simulation Training. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Examiner training and calibration are widely recommended to improve scoring consistency and defensibility in simulation‐based observed clinical competency assessments (SOCCAs), yet the empirical evidence has not yet been comprehensively explored. This scoping review maps and describes studies evaluating general examiner training and calibration interventions in SOCCAs.

Methods

A scoping review was conducted of peer‐reviewed studies that reported empirical evaluation or descriptive outcomes of examiner training and/or calibration in any SOCCA format (including OSCEs and OSLERs) across health profession disciplines and training stages. Data were charted on intervention characteristics, study design, outcome measures and reported effects. Given study heterogeneity, findings were synthesised descriptively.

Results

Twenty studies met inclusion criteria. Seven described general examiner training, although intervention reporting and evaluation were often insufficient to judge effectiveness. Two broad calibration approaches were identified: (i) general calibration aimed at aligning examiners' internal performance standards and (ii) case‐orientation calibration tailored to specific stations subsequently assessed. Most calibration interventions used frame‐of‐reference approaches, commonly involving video‐recorded benchmark performances with facilitated discussion. Effects on scoring outcomes were inconsistent: some studies reported modest improvements in scoring reliability or accuracy, whereas others showed minimal change or increased examiner stringency. Only one study assessed outcomes beyond scoring metrics to study examiner behaviours.

Discussion

Despite widespread endorsement, the evidence base for examiner training and calibration in SOCCAs remains limited and inconsistent. Where benefits were observed, they appeared most evident for borderline/uncertain performances, suggesting calibration may be most useful near decision thresholds. Additionally, this review highlights an unresolved tension in calibration aims, whether to promote score convergence, shared reasoning or both. Future work should specify intended mechanisms, address contextual influences on judgement and extend evaluation to impact on assessor behaviour. In the absence of stronger evidence, routine implementation risks being driven by expectation and convention rather than a sufficiently robust empirical rationale.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Clinical CompetenceEducational MeasurementSimulation TrainingHumansCalibrationReproducibility of Results

Autor:innen und Institutionen

  • Faculty of Biology, Medicine and Health, University of Manchester, Manchester, UK.
  • Clinical Teaching Fellow, Manchester University NHS Foundation Trust, Manchester, UK.

ORCID-Profile: Harish Thampy

Zitieren

APA

Thampy, H., Callanan, N., Ahmed, A., & Taromsari, S. (2026). Examiner training and calibration for simulated clinical examinations: A scoping review. Medical Education, 60(12), 1332-1349. https://doi.org/10.1111/medu.70253

Vancouver

Thampy H, Callanan N, Ahmed A, Taromsari S. Examiner training and calibration for simulated clinical examinations: A scoping review. Medical Education. 2026;60(12):1332-1349. doi:10.1111/medu.70253

BibTeX
@article{Thampy2026,
  author = {Thampy, Harish and Callanan, Niamh and Ahmed, Arslan and Taromsari, Sophia},
  title = {Examiner training and calibration for simulated clinical examinations: A scoping review},
  journal = {Medical Education},
  year = {2026},
  volume = {60},
  number = {12},
  pages = {1332--1349},
  doi = {10.1111/medu.70253}
}
Kostenlos starten →