EUVIMEDObjevte EUVIMED
Open access

Technical note: Generalizable and promptable artificial intelligence model to augment clinical delineation in radiation oncology

Lian Zhang, Zhengliang Liu, Lu Zhang, Zihao Wu, Xiaowei Yu, Jason Holmes, Hongying Feng, Haixing Dai, Xiang Li, Quanzheng Li, William W Wong, Sujay A Vora and 3 more

Medical Physics · 2024

DOI: 10.1002/mp.16965 ↗

At a glance

Journal article in Medical Physics, 2024. Written by Lian Zhang and 14 co-authors. Institution: Department of Radiation Oncology, Mayo Clinic, Phoenix, Arizona, USA. Major MEDLINE topics: Radiation Oncology, Deep Learning. Cited 23 times so far (Crossref); 62 references. The full text is freely available in PubMed Central. Funded by: NCI NIH HHS.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Background

Efficient and accurate delineation of organs at risk (OARs) is a critical procedure for treatment planning and dose evaluation. Deep learning‐based auto‐segmentation of OARs has shown promising results and is increasingly being used in radiation therapy. However, existing deep learning‐based auto‐segmentation approaches face two challenges in clinical practice: generalizability and human‐AI interaction. A generalizable and promptable auto‐segmentation model, which segments OARs of multiple disease sites simultaneously and supports on‐the‐fly human‐AI interaction, can significantly enhance the efficiency of radiation therapy treatment planning.

Purpose

Meta's segment anything model (SAM) was proposed as a generalizable and promptable model for next‐generation natural image segmentation. We further evaluated the performance of SAM in radiotherapy segmentation.

Methods

Computed tomography (CT) images of clinical cases from four disease sites at our institute were collected: prostate, lung, gastrointestinal, and head & neck. For each case, we selected the OARs important in radiotherapy treatment planning. We then compared both the Dice coefficients and Jaccard indices derived from three distinct methods: manual delineation (ground truth), automatic segmentation using SAM's ’segment anything’ mode, and automatic segmentation using SAM's ‘box prompt’ mode that implements manual interaction via live prompts during segmentation.

Results

Our results indicate that SAM's segment anything mode can achieve clinically acceptable segmentation results in most OARs with Dice scores higher than 0.7. SAM's box prompt mode further improves Dice scores by 0.1∼0.5. Similar results were observed for Jaccard indices. The results show that SAM performs better for prostate and lung, but worse for gastrointestinal and head & neck. When considering the size of organs and the distinctiveness of their boundaries, SAM shows better performance for large organs with distinct boundaries, such as lung and liver, and worse for smaller organs with less distinct boundaries, like parotid and cochlea.

Conclusions

Our results demonstrate SAM's robust generalizability with consistent accuracy in automatic segmentation for radiotherapy. Furthermore, the advanced box‐prompt method enables the users to augment auto‐segmentation interactively and dynamically, leading to patient‐specific auto‐segmentation in radiation therapy. SAM's generalizability across different disease sites and different modalities makes it feasible to develop a generic auto‐segmentation model in radiotherapy.

Subjects

MeSH terms (MEDLINE)

Radiation OncologyDeep LearningMaleHumansArtificial IntelligenceNeural Networks, ComputerTomography, X-Ray ComputedOrgans at RiskRadiotherapy Planning, Computer-AssistedImage Processing, Computer-Assisted

Author keywords

artificial intelligenceclinical delineationgeneralizablepromptableradiation oncologysegment anything model

Authors and institutions

  • Department of Radiation Oncology, Mayo Clinic, Phoenix, Arizona, USA.
  • School of Computing, University of Georgia, Athens, Georgia, USA.
  • Department of Computer Science and Engineering, University of Texas at Arlington, Arlington, Texas, USA.
  • Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, USA.

Funding

  • NCI NIH HHS

Cite

APA

Zhang, L., Liu, Z., Zhang, L., Wu, Z., Yu, X., Holmes, J., Feng, H., Dai, H., Li, X., Li, Q., Wong, W. W., Vora, S. A., Zhu, D., Liu, T., & Liu, W. (2024). Technical note: Generalizable and promptable artificial intelligence model to augment clinical delineation in radiation oncology. Medical Physics. https://doi.org/10.1002/mp.16965

Vancouver

Zhang L, Liu Z, Zhang L, Wu Z, Yu X, Holmes J, et al. Technical note: Generalizable and promptable artificial intelligence model to augment clinical delineation in radiation oncology. Medical Physics. 2024. doi:10.1002/mp.16965

BibTeX
@article{Zhang2024,
  author = {Zhang, Lian and Liu, Zhengliang and Zhang, Lu and Wu, Zihao and Yu, Xiaowei and Holmes, Jason and Feng, Hongying and Dai, Haixing and Li, Xiang and Li, Quanzheng and Wong, William W and Vora, Sujay A and Zhu, Dajiang and Liu, Tianming and Liu, Wei},
  title = {Technical note: Generalizable and promptable artificial intelligence model to augment clinical delineation in radiation oncology},
  journal = {Medical Physics},
  year = {2024},
  doi = {10.1002/mp.16965}
}
Start for free →