EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Uncertainty estimation using a 3D probabilistic U-Net for segmentation with small radiotherapy clinical trial datasets

Phillip Chlap, Hang Min, Jason Dowling, Matthew Field, Kirrily Cloak, Trevor Leong, Mark Lee, Julie Chu, Jennifer Tan, Phillip Tran, Tomas Kron, Mark Sidhom und 7 weitere

Computerized Medical Imaging and Graphics · 2024

DOI: 10.1016/j.compmedimag.2024.102403 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computerized Medical Imaging and Graphics, 2024. Verfasst von Phillip Chlap und 18 weiteren Autor:innen. Beteiligte Einrichtung: University of New South Wales, South Western Sydney Clinical School, Sydney, Australia; Ingham Institute for Applied Medical Research, Sydney, Austra…. Hauptthemen laut MEDLINE: Imaging, Three-Dimensional. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

BACKGROUND AND OBJECTIVES: Bio-medical image segmentation models typically attempt to predict one segmentation that resembles a ground-truth structure as closely as possible. However, as medical images are not perfect representations of anatomy, obtaining this ground truth is not possible. A surrogate commonly used is to have multiple expert observers define the same structure for a dataset. When multiple observers define the same structure on the same image there can be significant differences depending on the structure, image quality/modality and the region being defined. It is often desirable to estimate this type of aleatoric uncertainty in a segmentation model to help understand the region in which the true structure is likely to be positioned. Furthermore, obtaining these datasets is resource intensive so training such models using limited data may be required. With a small dataset size, differing patient anatomy is likely not well represented causing epistemic uncertainty which should also be estimated so it can be determined for which cases the model is effective or not. METHODS: We use a 3D probabilistic U-Net to train a model from which several segmentations can be sampled to estimate the range of uncertainty seen between multiple observers. To ensure that regions where observers disagree most are emphasised in model training, we expand the Generalised Evidence Lower Bound (ELBO) with a Constrained Optimisation (GECO) loss function with an additional contour loss term to give attention to this region. Ensemble and Monte-Carlo dropout (MCDO) uncertainty quantification methods are used during inference to estimate model confidence on an unseen case. We apply our methodology to two radiotherapy clinical trial datasets, a gastric cancer trial (TOPGEAR, TROG 08.08) and a post-prostatectomy prostate cancer trial (RAVES, TROG 08.03). Each dataset contains only 10 cases each for model development to segment the clinical target volume (CTV) which was defined by multiple observers on each case. An additional 50 cases are available as a hold-out dataset for each trial which had only one observer define the CTV structure on each case. Up to 50 samples were generated using the probabilistic model for each case in the hold-out dataset. To assess performance, each manually defined structure was matched to the closest matching sampled segmentation based on commonly used metrics. RESULTS: The TOPGEAR CTV model achieved a Dice Similarity Coefficient (DSC) and Surface DSC (sDSC) of 0.7 and 0.43 respectively with the RAVES model achieving 0.75 and 0.71 respectively. Segmentation quality across cases in the hold-out datasets was variable however both the ensemble and MCDO uncertainty estimation approaches were able to accurately estimate model confidence with a p-value < 0.001 for both TOPGEAR and RAVES when comparing the DSC using the Pearson correlation coefficient. CONCLUSIONS: We demonstrated that training auto-segmentation models which can estimate aleatoric and epistemic uncertainty using limited datasets is possible. Having the model estimate prediction confidence is important to understand for which unseen cases a model is likely to be useful.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Imaging, Three-DimensionalHumansUncertaintyProstatic NeoplasmsMaleClinical Trials as TopicDatasets as TopicAlgorithmsTomography, X-Ray Computed

Stichwörter der Autor:innen

Auto-segmentationClinical target volumeDeep learningGastric cancerProstate cancerRadiotherapyUncertainty estimation

Autor:innen und Institutionen

  • University of New South Wales, South Western Sydney Clinical School, Sydney, Australia; Ingham Institute for Applied Medical Research, Sydney, Australia; Liverpool and Macarthur Cancer Therapy Centres, Department of Rad…
  • University of New South Wales, South Western Sydney Clinical School, Sydney, Australia; Ingham Institute for Applied Medical Research, Sydney, Australia; CSIRO Australian e-Health Research Centre, Herston, Australia.
  • Peter MacCallum Cancer Centre, Melbourne, Australia; The Sir Peter MacCallum Department of Oncology, University of Melbourne, Melbourne, Australia.
  • Ingham Institute for Applied Medical Research, Sydney, Australia.
  • Peter MacCallum Cancer Centre, Melbourne, Australia.
  • University of New South Wales, South Western Sydney Clinical School, Sydney, Australia; Liverpool and Macarthur Cancer Therapy Centres, Department of Radiation Oncology, Sydney, Australia.

Zitieren

APA

Chlap, P., Min, H., Dowling, J., Field, M., Cloak, K., Leong, T., Lee, M., Chu, J., Tan, J., Tran, P., Kron, T., Sidhom, M., Wiltshire, K., Keats, S., Kneebone, A., Haworth, A., Ebert, M. A., Vinod, S. K., & Holloway, L. (2024). Uncertainty estimation using a 3D probabilistic U-Net for segmentation with small radiotherapy clinical trial datasets. Computerized Medical Imaging and Graphics. https://doi.org/10.1016/j.compmedimag.2024.102403

Vancouver

Chlap P, Min H, Dowling J, Field M, Cloak K, Leong T, et al. Uncertainty estimation using a 3D probabilistic U-Net for segmentation with small radiotherapy clinical trial datasets. Computerized Medical Imaging and Graphics. 2024. doi:10.1016/j.compmedimag.2024.102403

BibTeX
@article{Chlap2024,
  author = {Chlap, Phillip and Min, Hang and Dowling, Jason and Field, Matthew and Cloak, Kirrily and Leong, Trevor and Lee, Mark and Chu, Julie and Tan, Jennifer and Tran, Phillip and Kron, Tomas and Sidhom, Mark and Wiltshire, Kirsty and Keats, Sarah and Kneebone, Andrew and Haworth, Annette and Ebert, Martin A and Vinod, Shalini K and Holloway, Lois},
  title = {Uncertainty estimation using a 3D probabilistic U-Net for segmentation with small radiotherapy clinical trial datasets},
  journal = {Computerized Medical Imaging and Graphics},
  year = {2024},
  doi = {10.1016/j.compmedimag.2024.102403}
}
Kostenlos starten →