EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The impact of uncertainty estimation on radiomic segmentation reproducibility and scan–rescan repeatability in kidney MRI

Rossella Damiano, Ettore Lanzarone, Francesca Lussana, Giulia Villa, Alexander J Daniel, Susan Francis, Anna Caroli, Elisa Scalco

Medical Physics · 2025-07 · 52 (7)

DOI: 10.1002/mp.17995 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Medical Physics, online erschienen am 15.07.2025. Verfasst von Rossella Damiano und 7 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Biomedical Technologies (ITB), National Research Council (CNR), Milan, Italy. Hauptthemen laut MEDLINE: Magnetic Resonance Imaging, Kidney, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministero dell'Università e della Ricerca, Ministero della Salute, Medical Research Council.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Radiomics holds great potential but is hindered by segmentation and scan–rescan variability, which affect the reproducibility and repeatability of radiomic analysis, respectively. Recently, deep learning (DL) has shown promise in improving segmentation accuracy, thereby enhancing radiomic stability. Moreover, including uncertainty quantification into DL models could provide confidence assessments for segmentations, ultimately improving the trustworthiness and robustness of radiomic outputs.

Purpose

This study investigated whether the reproducibility and repeatability of radiomic features, in relation to segmentation and scan–rescan variability, respectively, could be enhanced by extracting features exclusively from confidently segmented regions, rather than from regions defined without accounting for uncertainty‐related information. Additionally, this study assessed whether stable features derived from uncertainty‐informed segmentation could improve the classification of healthy versus pathological subjects.

Methods

A publicly available kidney MRI dataset, including subjects with chronic kidney disease (CKD) and healthy controls (HC), was used to assess the robustness of the segmentation methods across diverse clinical scenarios. A deterministic U‐Net model was first implemented to generate kidney masks without considering segmentation uncertainty. Then, Monte Carlo dropout (MCD) and test‐time augmentation (TTA) were applied to address uncertainty in DL‐based segmentation. Both methods were trained using the traditional Dice loss and a recently proposed Dice Plus loss to improve model calibration. Confidence level‐based masks were defined from the predictions with uncertainty, identifying kidney regions segmented with different levels of certainty. Radiomic features were extracted from ground truth masks, deterministic masks, and confidence level‐based masks. These features were grouped into four classes based on their intraclass correlation coefficient values in relation to both segmentation and scan–rescan variability. Finally, based on the identified stable features, a classification model was developed for each approach to distinguish between CKD and HC subjects.

Results

The accuracy results were comparable across all the implemented models, with Dice score coefficients consistently above or near 0.9. Most radiomic features were unstable with respect to both segmentation and scan–rescan variability when uncertainty information was not considered. However, including uncertainty increased the number of features repeatable with respect to scan–rescan variability in both CKD and HC subjects. The greatest improvement was observed with the MCD approach trained with the Dice Plus loss, whereby the number of repeatable features increased from 24 to 70 out of 105 in total, for both CKD and HC subjects. Improvements in reproducibility with respect to segmentation variability were not consistent across methods and subject groups. Regarding the classification analysis, all uncertainty‐based approaches performed comparable to the references in terms of ROC curves.

Conclusions

Integrating uncertainty quantification into DL‐based segmentation for radiomic features extraction represents a promising approach to enhance the robustness of radiomic analysis against segmentation and scan–rescan variability, as well as its ability in distinguishing pathological from healthy subjects. Additionally, such integration improves the reliability and interpretability of radiomic analysis, contributing to more informed clinical decision‐making.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Magnetic Resonance ImagingKidneyImage Processing, Computer-AssistedUncertaintyHumansReproducibility of ResultsDeep LearningMonte Carlo MethodRadiomics

Stichwörter der Autor:innen

MRI kidney segmentationU‐Netradiomic stabilityuncertainty quantification

Autor:innen und Institutionen

  • Institute of Biomedical Technologies (ITB), National Research Council (CNR), Milan, Italy.
  • Department of Management, Information and Production Engineering, University of Bergamo, Bergamo, Italy.
  • Department of Bioengineering, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Bergamo, Italy.
  • Sir Peter Mansfield Imaging Centre, University Park, University of Nottingham, Nottingham, UK.
  • NIHR Nottingham Biomedical Research Centre, Nottingham, UK.

Förderung

  • Ministero dell'Università e della Ricerca
  • Ministero della Salute
  • Medical Research Council

Zitieren

APA

Damiano, R., Lanzarone, E., Lussana, F., Villa, G., Daniel, A. J., Francis, S., Caroli, A., & Scalco, E. (2025). The impact of uncertainty estimation on radiomic segmentation reproducibility and scan–rescan repeatability in kidney MRI. Medical Physics, 52(7). https://doi.org/10.1002/mp.17995

Vancouver

Damiano R, Lanzarone E, Lussana F, Villa G, Daniel AJ, Francis S, et al. The impact of uncertainty estimation on radiomic segmentation reproducibility and scan–rescan repeatability in kidney MRI. Medical Physics. 2025;52(7). doi:10.1002/mp.17995

BibTeX
@article{Damiano2025,
  author = {Damiano, Rossella and Lanzarone, Ettore and Lussana, Francesca and Villa, Giulia and Daniel, Alexander J and Francis, Susan and Caroli, Anna and Scalco, Elisa},
  title = {The impact of uncertainty estimation on radiomic segmentation reproducibility and scan–rescan repeatability in kidney MRI},
  journal = {Medical Physics},
  year = {2025},
  volume = {52},
  number = {7},
  doi = {10.1002/mp.17995}
}
Kostenlos starten →