Fairness, Consistency and Bias in the RACS General Surgery Fellowship Examination
ANZ Journal of Surgery · 2026
DOI: 10.1111/ans.70503 ↗At a glance
Journal article in ANZ Journal of Surgery, 2026. Written by Douglas Stupart and 6 co-authors. Institution: Deakin University and University Hospital Geelong, Geelong, Australia. Major MEDLINE topics: Fellowships and Scholarships, General Surgery, Sexism, Educational Measurement. 21 references. The full text is freely available (open access, CC BY-NC-ND 4.0).
Abstract (original language)
Introduction
The General Surgery Fellowship Examination is the final hurdle examination before being eligible for fellowship of the Royal Australasian College of Surgeons. The purpose of this study was to assess the consistency and reliability of this examination, specifically whether there was evidence of systemic gender bias.
Methods
This is a retrospective audit of marks awarded in the examination between 2018 and 2022. Examination components were marked separately by two examiners, who assigned a consensus mark after discussion. Candidates' marks were analysed according to their demographics. Inter‐observer agreement between examining pairs was analysed, as were marks awarded by individual examiners.
Results
Overall, 811 candidates (548 [67%] men and 263 [33%] women) sat the examination, of whom 520 (64%) passed. The pass rate was consistent over the study period. A total of 5672 pairs of examiners' marks were analysed to determine inter‐observer agreement. Inter‐observer correlation was 0.89 (95% C.I. 0.88–0.89). There were 110 examiners (92 men and 18 women). No examiner's marks were outside the 95% control limit for strictness or leniency compared with their peers. Pass rates were similar for male and female candidates (343/548 [63%] male vs. 177/263 [67%], p = 0.20). There were 102 marking pairs with one female and one male examiner. Inter‐rater agreement between these examiners was 0.86 (95% CI: 0.82–0.91) when examining men and 0.76 (95% CI: 0.76–0.85) for women.
Conclusion
We found the examination to be consistent, fair and reliable, with no evidence of systemic gender bias.
Subjects
MeSH terms (MEDLINE)
Authors and institutions
- Deakin University and University Hospital Geelong, Geelong, Australia.
- Royal Melbourne Hospital and University of Melbourne, Parkville, Australia.
- Deakin University, Melbourne, Australia.
- Flinders Medical Centre, Adelaide, Australia.
- University of Wollongong, Wollongong, Australia.
- Australian National University and the Canberra Hospital, Canberra, Australia.
ORCID profiles: Douglas Stupart, Kirk Underwood
Cite
APA
Stupart, D., Read, D., Underwood, K., Hollington, P., Ashford, B., Watters, D., & Mosse, C. (2026). Fairness, Consistency and Bias in the RACS General Surgery Fellowship Examination. ANZ Journal of Surgery. https://doi.org/10.1111/ans.70503
Vancouver
Stupart D, Read D, Underwood K, Hollington P, Ashford B, Watters D, et al. Fairness, Consistency and Bias in the RACS General Surgery Fellowship Examination. ANZ Journal of Surgery. 2026. doi:10.1111/ans.70503
BibTeX
@article{Stupart2026,
author = {Stupart, Douglas and Read, David and Underwood, Kirk and Hollington, Paul and Ashford, Bruce and Watters, David and Mosse, Charles},
title = {Fairness, Consistency and Bias in the RACS General Surgery Fellowship Examination},
journal = {ANZ Journal of Surgery},
year = {2026},
doi = {10.1111/ans.70503}
}
EUVIMED