Automated confidence estimation in deep learning auto‐segmentation for brain organs at risk on MRI for radiotherapy
Journal of Applied Clinical Medical Physics · 2024
DOI: 10.1002/acm2.14513 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Applied Clinical Medical Physics, 2024. Verfasst von Nouf M Alzahrani und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Diagnostic Radiology, King Abdulaziz University, Jeddah, Saudi Arabia. Hauptthemen laut MEDLINE: Deep Learning, Organs at Risk, Magnetic Resonance Imaging, Radiotherapy Planning, Computer-Assisted. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 16 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Cancer Research UK for the Leeds Radiotherapy Research Centre of Excellence, Yorkshire Cancer Research.
Abstract (Originalsprache)
Purpose
We have built a novel AI‐driven QA method called AutoConfidence (ACo), to estimate segmentation confidence on a per‐voxel basis without gold standard segmentations, enabling robust, efficient review of automated segmentation (AS). We have demonstrated this method in brain OAR AS on MRI, using internal and external (third‐party) AS models.
Methods
Thirty‐two retrospectives, MRI planned, glioma cases were randomly selected from a local clinical cohort for ACo training. A generator was trained adversarialy to produce internal autosegmentations (IAS) with a discriminator to estimate voxel‐wise IAS uncertainty, given the input MRI. Confidence maps for each proposed segmentation were produced for operator use in AS editing and were compared with “difference to gold‐standard” error maps. Nine cases were used for testing ACo performance on IAS and validation with two external deep learning segmentation model predictions [external model with low‐quality AS (EM‐LQ) and external model with high‐quality AS (EM‐HQ)]. Matthew's correlation coefficient (MCC), false‐positive rate (FPR), false‐negative rate (FNR), and visual assessment were used for evaluation. Edge removal and geometric distance corrections were applied to achieve more useful and clinically relevant confidence maps and performance metrics.
Results
ACo showed generally excellent performance on both internal and external segmentations, across all OARs (except lenses). MCC was higher on IAS and low‐quality external segmentations (EM‐LQ) than high‐quality ones (EM‐HQ). On IAS and EM‐LQ, average MCC (excluding lenses) varied from 0.6 to 0.9, while average FPR and FNR were ≤0.13 and ≤0.21, respectively. For EM‐HQ, average MCC varied from 0.4 to 0.8, while average FPR and FNR were ≤0.37 and ≤0.22, respectively.
Conclusion
ACo was a reliable predictor of uncertainty and errors on AS generated both internally and externally, demonstrating its potential as an independent, reference‐free QA tool, which could help operators deliver robust, efficient autosegmentation in the radiotherapy clinic.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Diagnostic Radiology, King Abdulaziz University, Jeddah, Saudi Arabia.
- School of Medicine, University of Leeds, Leeds, UK.
- Department of Clinical Oncology, St James's University Hospital, Leeds, UK.
- Department of Medical Physics and Engineering, St James's University Hospital, Leeds, UK.
Förderung
- Cancer Research UK for the Leeds Radiotherapy Research Centre of Excellence
- Yorkshire Cancer Research
Zitieren
APA
Alzahrani, N. M., Henry, A. M., Al-Qaisieh, B. M., Murray, L. J., & Nix, M. G. (2024). Automated confidence estimation in deep learning auto‐segmentation for brain organs at risk on MRI for radiotherapy. Journal of Applied Clinical Medical Physics. https://doi.org/10.1002/acm2.14513
Vancouver
Alzahrani NM, Henry AM, Al-Qaisieh BM, Murray LJ, Nix MG. Automated confidence estimation in deep learning auto‐segmentation for brain organs at risk on MRI for radiotherapy. Journal of Applied Clinical Medical Physics. 2024. doi:10.1002/acm2.14513
BibTeX
@article{Alzahrani2024,
author = {Alzahrani, Nouf M and Henry, Ann M and Al-Qaisieh, Bashar M and Murray, Louise J and Nix, Michael G},
title = {Automated confidence estimation in deep learning auto‐segmentation for brain organs at risk on MRI for radiotherapy},
journal = {Journal of Applied Clinical Medical Physics},
year = {2024},
doi = {10.1002/acm2.14513}
}
EUVIMED