EUVIMEDOdkrijte EUVIMED
Open access · CC BY 4.0

Clinical VMAT machine parameter optimization for localized prostate cancer using deep reinforcement learning

William T Hrinivich, Mahasweta Bhattacharya, Lina Mekki, Todd McNutt, Xun Jia, Heng Li, Daniel Y Song, Junghoon Lee

Medical Physics · 2024

DOI: 10.1002/mp.17100 ↗

At a glance

Journal article in Medical Physics, 2024. Written by William T Hrinivich and 7 co-authors. Institution: Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, Maryland, USA. Major MEDLINE topics: Prostatic Neoplasms, Radiotherapy, Intensity-Modulated, Radiotherapy Planning, Computer-Assisted, Deep Learning. Cited 10 times so far (Crossref); 34 references. The full text is freely available (open access, CC BY 4.0). Funded by: Commonwealth Fund.

PovzetekSubjectsBibliografski podatkiCiteRelated studies

Abstract (original language)

Background

Volumetric modulated arc therapy (VMAT) machine parameter optimization (MPO) remains computationally expensive and sensitive to input dose objectives creating challenges for manual and automatic planning. Reinforcement learning (RL) involves machine learning through extensive trial‐and‐error, demonstrating performance exceeding humans, and existing algorithms in several domains.

Purpose

To develop and evaluate an RL approach for VMAT MPO for localized prostate cancer to rapidly and automatically generate deliverable VMAT plans for a clinical linear accelerator (linac) and compare resultant dosimetry to clinical plans.

Methods

We extended our previous RL approach to enable VMAT MPO of a 3D beam model for a clinical linac through a policy network. It accepts an input state describing the current control point and predicts continuous machine parameters for the next control point, which are used to update the input state, repeating until plan termination. RL training was conducted to minimize a dose‐based cost function for prescription of 60 Gy in 20 fractions using CT scans and contours from 136 retrospective localized prostate cancer patients, 20 of which had existing plans used to initialize training. Data augmentation was employed to mitigate over‐fitting, and parameter exploration was achieved using Gaussian perturbations. Following training, RL VMAT was applied to an independent cohort of 15 patients, and the resultant dosimetry was compared to clinical plans. We also combined the RL approach with our clinical treatment planning system (TPS) to automate final plan refinement, and creating the potential for manual review and edits as required for clinical use.

Results

RL training was conducted for 5000 iterations, producing 40 000 plans during exploration. Mean ± SD execution time to produce deliverable VMAT plans in the test cohort was 3.3 ± 0.5 s which were automatically refined in the TPS taking an additional 77.4 ± 5.8 s. When normalized to provide equivalent target coverage, the RL+TPS plans provided a similar mean ± SD overall maximum dose of 63.2 ± 0.6 Gy and a lower mean rectum dose of 17.4 ± 7.4 compared to 63.9 ± 1.5 Gy ( p = 0.061) and 21.0 ± 6.0 ( p = 0.024) for the clinical plans.

Conclusions

An approach for VMAT MPO using RL for a clinical linac model was developed and applied to automatically generate deliverable plans for localized prostate cancer patients, and when combined with the clinical TPS shows potential to rapidly generate high‐quality plans. The RL VMAT approach shows promise to discover advanced linac control policies through trial‐and‐error, and algorithm limitations and future directions are identified and discussed.

Subjects

MeSH terms (MEDLINE)

Prostatic NeoplasmsRadiotherapy, Intensity-ModulatedRadiotherapy Planning, Computer-AssistedDeep LearningMaleHumansRadiotherapy DosageMachine Learning

Author keywords

VMATartificial intelligenceautomationdeep learningprostate cancerreinforcement learning

Authors and institutions

  • Department of Radiation Oncology and Molecular Radiation Sciences, Johns Hopkins University, Baltimore, Maryland, USA.

Funding

  • Commonwealth Fund

Cite

APA

Hrinivich, W. T., Bhattacharya, M., Mekki, L., McNutt, T., Jia, X., Li, H., Song, D. Y., & Lee, J. (2024). Clinical VMAT machine parameter optimization for localized prostate cancer using deep reinforcement learning. Medical Physics. https://doi.org/10.1002/mp.17100

Vancouver

Hrinivich WT, Bhattacharya M, Mekki L, McNutt T, Jia X, Li H, et al. Clinical VMAT machine parameter optimization for localized prostate cancer using deep reinforcement learning. Medical Physics. 2024. doi:10.1002/mp.17100

BibTeX
@article{Hrinivich2024,
  author = {Hrinivich, William T and Bhattacharya, Mahasweta and Mekki, Lina and McNutt, Todd and Jia, Xun and Li, Heng and Song, Daniel Y and Lee, Junghoon},
  title = {Clinical VMAT machine parameter optimization for localized prostate cancer using deep reinforcement learning},
  journal = {Medical Physics},
  year = {2024},
  doi = {10.1002/mp.17100}
}
Start for free →