Retrospective Cohort Comparison of Self, Peer, Near‐Peer, and Faculty Assessment of a Pharmacy Teaching Objective Structured Clinical Examination
JACCP: JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY · 2026-11 · 9 (11)
DOI: 10.1002/jac5.70317 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift JACCP: JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY, online erschienen am 05.11.2026. Verfasst von Chelsea A Ludwig und 2 weiteren Autor:innen. Beteiligte Einrichtung: Veteran Health Indiana, Indianapolis, Indiana, USA. Hauptthemen laut MEDLINE: Education, Pharmacy, Peer Group, Educational Measurement, Students, Pharmacy. Die Arbeit nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Objective Structured Clinical Examinations (OSCEs) are systematic assessments that evaluate various skills in health care professional education curricula. OSCEs and Teaching OSCEs (TOSCEs) are traditionally evaluated by faculty, and there is currently a paucity of literature comparing the use of self, peer, and near‐peer evaluation in formative teaching OSCEs. The purpose of this study was to compare asynchronous self, peer, near‐peer, and faculty assessments of a patient counseling TOSCE station.
Methods
Second‐year student pharmacists in a skills laboratory course participated in a newly created formative TOSCE in fall 2023. The patient counseling station was evaluated by four individuals (self, peer classmate, near‐peer, and faculty) using a standardized analytical checklist. Mean scores were analyzed for differences between groups using a repeated measures Analysis of Variance (ANOVA) test. A quality improvement survey was distributed to students, and responses from two questions related to perceived accuracy of TOSCE evaluations and usefulness of feedback from each evaluator were examined.
Results
TOSCE scores from self, peer, and near‐peer evaluations were statistically significantly higher when compared with faculty (0.57, 0.85, 0.81, respectively). The Intraclass Correlation Coefficient (ICC) used to measure inter‐rater reliability was 0.840 (95% confidence interval [CI] 0.792–0.880). Most students perceived that the self, peer, near‐peer, and faculty evaluators were accurate and provided useful feedback.
Conclusion
A statistically significant difference was detected between faculty and non‐faculty (self, peer, and near‐peer) scores on the patient counseling TOSCE simulation; however, the absolute difference was small, suggesting that the finding may have limited educational or practical significance. Student perceived accuracy and feedback usefulness were similar for all evaluator groups. Both findings reveal an opportunity for the use of non‐faculty evaluators for assessment of TOSCE simulations.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Veteran Health Indiana, Indianapolis, Indiana, USA.
- Purdue University College of Pharmacy, West Lafayette, Indiana, USA.
ORCID-Profile: Chelsea A Ludwig, Jamie L Woodyard, Chelsea M Baker
Zitieren
APA
Ludwig, C. A., Woodyard, J. L., & Baker, C. M. (2026). Retrospective Cohort Comparison of Self, Peer, Near‐Peer, and Faculty Assessment of a Pharmacy Teaching Objective Structured Clinical Examination. JACCP: JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY, 9(11). https://doi.org/10.1002/jac5.70317
Vancouver
Ludwig CA, Woodyard JL, Baker CM. Retrospective Cohort Comparison of Self, Peer, Near‐Peer, and Faculty Assessment of a Pharmacy Teaching Objective Structured Clinical Examination. JACCP: JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY. 2026;9(11). doi:10.1002/jac5.70317
BibTeX
@article{Ludwig2026,
author = {Ludwig, Chelsea A and Woodyard, Jamie L and Baker, Chelsea M},
title = {Retrospective Cohort Comparison of Self, Peer, Near‐Peer, and Faculty Assessment of a Pharmacy Teaching Objective Structured Clinical Examination},
journal = {JACCP: JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY},
year = {2026},
volume = {9},
number = {11},
doi = {10.1002/jac5.70317}
}
EUVIMED