EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Development and validation of a methodology to simulate interobserver variability

Rhianna C Brown iD, Amy Walker, Phillip Chlap iD, Karen Lim iD, Dean L Cutajar, Peter Metcalfe, Lois Holloway iD

Biomedical Physics & Engineering Express · 17.11.2026

DOI: 10.1088/2057-1976/aec2f2 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Biomedical Physics & Engineering Express, online erschienen am 17.11.2026. Verfasst von Rhianna C Brown und 6 weiteren Autor:innen. Beteiligte Einrichtung: University of Wollongong Centre for Medical Radiation Physics, Northfields Ave, Wollongong, New South Wales, 2522, Australia. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective. Contouring for radiotherapy planning remains time intensive. As such, interobserver contour variation (IOV) studies are limited in patient and/or observer numbers (1). This study provides a methodology to simulate IOV on images containing a single contour.
Approach. 
14 gynaecological cancer radiotherapy target volumes delineated by five observers on T2W-MRI scans were used to develop an AI-based approach and three rule-based (simple, normal, adapted) approaches to generate estimated minimum and maximum (min/max) contours. The rule-based approaches used delineation uncertainty of the observers’ contours. The AI-based approach combined seven nnU-Net models into an ensemble. The development of the AI-based and rule-based approaches utilised 7-fold and leave-one-out cross validation, respectively. Validation used a separate/second dataset with the same characteristics and six observers. A single contour was used as the basis and the remaining five contours were used to generate the min/max contours Performance of each approach was assessed using dice similarity coefficient (DSC), mean surface distance (MSD), surface DSC (sDSC) and Hausdorff distance (HD). The best approach was utilised in a pipeline to generate a min/max contour. Multiple contours were generated between these by applying non-uniform expansions and contractions to a single contour. The comparison metrics of the observers’ and simulated contours were computed in pairwise, with a mean and standard deviation calculated.
Main Results. The adapted rule-based approach performed best across all metrics and was used in the subsequent pipeline. The AI-based approach had comparative median values to the rule-based approaches, but a much wider range of values. The observers’ and simulated contours had a DSC of 0.77±0.13 and 0.78±0.20, respectively and an MSD of 2.4±1.7 mm and 2.2±1.5 mm, respectively.
Significance. This study provides a methodology to generate additional observer contours from a single observer contour based on IOV data.

Schlagwörter

Stichwörter der Autor:innen

gynaecological cancerinterobserver variationsegmentation

Autor:innen und Institutionen

  • University of Wollongong Centre for Medical Radiation Physics, Northfields Ave, Wollongong, New South Wales, 2522, Australia.
  • University of Wollongong Centre for Medical Radiation Physics, Northfields Av, Wollongong, New South Wales, 2522, Australia.
  • Medical Physics, Ingham Institute for Applied Medical Research, 1 Campbell St, Liverpool, Liverpool, New South Wales, 2170, Australia.
  • Liverpool Cancer Therapy Centre, Burnside Dr, Liverpool, New South Wales, 2170, Australia.
  • Centre for Medical Radiation Physics, University of Wollongong Centre for Medical Radiation Physics, Northfields Av, Wollongong, New South Wales, 2522, Australia.
  • University of Wollongong Centre for Medical Radiation Physics, Northfields Avenue, Wollongong, New South Wales, 2522, Australia.

ORCID-Profile: Rhianna C Brown, Phillip Chlap, Karen Lim, Lois Holloway

Zitieren

APA

Brown, R. C., Walker, A., Chlap, P., Lim, K., Cutajar, D. L., Metcalfe, P., & Holloway, L. (2026). Development and validation of a methodology to simulate interobserver variability. Biomedical Physics & Engineering Express. https://doi.org/10.1088/2057-1976/aec2f2

Vancouver

Brown RC, Walker A, Chlap P, Lim K, Cutajar DL, Metcalfe P, et al. Development and validation of a methodology to simulate interobserver variability. Biomedical Physics & Engineering Express. 2026. doi:10.1088/2057-1976/aec2f2

BibTeX
@article{Brown2026,
  author = {Brown, Rhianna C and Walker, Amy and Chlap, Phillip and Lim, Karen and Cutajar, Dean L and Metcalfe, Peter and Holloway, Lois},
  title = {Development and validation of a methodology to simulate interobserver variability},
  journal = {Biomedical Physics & Engineering Express},
  year = {2026},
  doi = {10.1088/2057-1976/aec2f2}
}
Kostenlos starten →