Objective Structured Assessment of Technical Skills in Mastoidectomy Using 3D ‐Printed Temporal Bones
The Laryngoscope · 2026-09 · 136 (9) · 3764-3770
DOI: 10.1002/lary.70583 ↗Kurz gefasst
Beobachtungsstudie in der Zeitschrift The Laryngoscope, online erschienen am 08.05.2026. Verfasst von Vanessa Helou und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Otolaryngology-Head and Neck Surgery, University of Pittsburgh, Pittsburgh, Pennsylvania, USA. Hauptthemen laut MEDLINE: Clinical Competence, Mastoidectomy, Temporal Bone, Internship and Residency. Die Arbeit nennt 16 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objective
To evaluate the use of three‐dimensional (3D) printed temporal bone models combined with final product analysis as an objective structured assessment of technical skills tool to assess mastoidectomy performance across levels of otolaryngology residency training.
Methods
In this prospective observational study conducted at a single academic otolaryngology residency program, 32 residents performed 64 mastoidectomies on 3D‐printed temporal bone models over a three‐year period. Three expert faculty independently and anonymously evaluated each performance using a validated 14‐item final product analysis checklist. Statistical analyses included linear regression, ANOVA, Mann–Whitney U, Wilcoxon signed‐rank tests, and intraclass correlation coefficient (ICC) for inter‐rater reliability.
Results
Median scores improved steadily with training level, from 35.0 in postgraduate year (PGY) 1 to 53.7 in PGY 5 out of 70. Linear regression demonstrated a significant positive association between both training level and duration in residency with performance. Senior residents (PGY 4–5, median score 54.0) significantly outperformed junior residents (PGY 1–3, median score 38.0; p = 0.012). Across all training levels, median scores improved from 43.2 on the first attempt to 52.5 on the third, though this difference was not statistically significant. Inter‐rater reliability was excellent (ICC = 0.9210, p < 0.0001). A proficiency cutoff score of 45/70 was established using the contrasting groups method.
Conclusion
The consistency of 3D‐printed temporal bones judged by final product analysis allows for fair, objective, and reliable assessment for formative and summative evaluations. By longitudinally tracking skill improvement and differentiating performance across training levels, it supports the transition to competency‐based surgical education. Level of Evidence N/A.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Otolaryngology-Head and Neck Surgery, University of Pittsburgh, Pittsburgh, Pennsylvania, USA.
- Department of Head and Neck Surgery, University of California Los Angeles, Los Angeles, California, USA.
ORCID-Profile: Vanessa Helou
Zitieren
APA
Helou, V., Khalil, L., Perez, P. L., McCall, A. A., & Jabbour, N. (2026). Objective Structured Assessment of Technical Skills in Mastoidectomy Using 3D ‐Printed Temporal Bones. The Laryngoscope, 136(9), 3764-3770. https://doi.org/10.1002/lary.70583
Vancouver
Helou V, Khalil L, Perez PL, McCall AA, Jabbour N. Objective Structured Assessment of Technical Skills in Mastoidectomy Using 3D ‐Printed Temporal Bones. The Laryngoscope. 2026;136(9):3764-3770. doi:10.1002/lary.70583
BibTeX
@article{Helou2026,
author = {Helou, Vanessa and Khalil, Lucien and Perez, Philip L and McCall, Andrew A and Jabbour, Noel},
title = {Objective Structured Assessment of Technical Skills in Mastoidectomy Using 3D ‐Printed Temporal Bones},
journal = {The Laryngoscope},
year = {2026},
volume = {136},
number = {9},
pages = {3764--3770},
doi = {10.1002/lary.70583}
}
EUVIMED