Development and validation of a methodology to simulate interobserver variability
Biomedical Physics & Engineering Express · 17.11.2026
DOI: 10.1088/2057-1976/aec2f2 ↗Kurz gefasst
Fachartikel in der Zeitschrift Biomedical Physics & Engineering Express, online erschienen am 17.11.2026. Verfasst von Rhianna C Brown und 6 weiteren Autor:innen. Beteiligte Einrichtung: University of Wollongong Centre for Medical Radiation Physics, Northfields Ave, Wollongong, New South Wales, 2522, Australia. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objective. Contouring for radiotherapy planning remains time intensive. As such, interobserver contour variation (IOV) studies are limited in patient and/or observer numbers (1). This study provides a methodology to simulate IOV on images containing a single contour.
Approach. 
14 gynaecological cancer radiotherapy target volumes delineated by five observers on T2W-MRI scans were used to develop an AI-based approach and three rule-based (simple, normal, adapted) approaches to generate estimated minimum and maximum (min/max) contours. The rule-based approaches used delineation uncertainty of the observers’ contours. The AI-based approach combined seven nnU-Net models into an ensemble. The development of the AI-based and rule-based approaches utilised 7-fold and leave-one-out cross validation, respectively. Validation used a separate/second dataset with the same characteristics and six observers. A single contour was used as the basis and the remaining five contours were used to generate the min/max contours Performance of each approach was assessed using dice similarity coefficient (DSC), mean surface distance (MSD), surface DSC (sDSC) and Hausdorff distance (HD). The best approach was utilised in a pipeline to generate a min/max contour. Multiple contours were generated between these by applying non-uniform expansions and contractions to a single contour. The comparison metrics of the observers’ and simulated contours were computed in pairwise, with a mean and standard deviation calculated.
Main Results. The adapted rule-based approach performed best across all metrics and was used in the subsequent pipeline. The AI-based approach had comparative median values to the rule-based approaches, but a much wider range of values. The observers’ and simulated contours had a DSC of 0.77±0.13 and 0.78±0.20, respectively and an MSD of 2.4±1.7 mm and 2.2±1.5 mm, respectively.
Significance. This study provides a methodology to generate additional observer contours from a single observer contour based on IOV data.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- University of Wollongong Centre for Medical Radiation Physics, Northfields Ave, Wollongong, New South Wales, 2522, Australia.
- University of Wollongong Centre for Medical Radiation Physics, Northfields Av, Wollongong, New South Wales, 2522, Australia.
- Medical Physics, Ingham Institute for Applied Medical Research, 1 Campbell St, Liverpool, Liverpool, New South Wales, 2170, Australia.
- Liverpool Cancer Therapy Centre, Burnside Dr, Liverpool, New South Wales, 2170, Australia.
- Centre for Medical Radiation Physics, University of Wollongong Centre for Medical Radiation Physics, Northfields Av, Wollongong, New South Wales, 2522, Australia.
- University of Wollongong Centre for Medical Radiation Physics, Northfields Avenue, Wollongong, New South Wales, 2522, Australia.
ORCID-Profile: Rhianna C Brown, Phillip Chlap, Karen Lim, Lois Holloway
Zitieren
APA
Brown, R. C., Walker, A., Chlap, P., Lim, K., Cutajar, D. L., Metcalfe, P., & Holloway, L. (2026). Development and validation of a methodology to simulate interobserver variability. Biomedical Physics & Engineering Express. https://doi.org/10.1088/2057-1976/aec2f2
Vancouver
Brown RC, Walker A, Chlap P, Lim K, Cutajar DL, Metcalfe P, et al. Development and validation of a methodology to simulate interobserver variability. Biomedical Physics & Engineering Express. 2026. doi:10.1088/2057-1976/aec2f2
BibTeX
@article{Brown2026,
author = {Brown, Rhianna C and Walker, Amy and Chlap, Phillip and Lim, Karen and Cutajar, Dean L and Metcalfe, Peter and Holloway, Lois},
title = {Development and validation of a methodology to simulate interobserver variability},
journal = {Biomedical Physics & Engineering Express},
year = {2026},
doi = {10.1088/2057-1976/aec2f2}
}
EUVIMED