EUVIMEDEUVIMED entdecken
Crossref

Automating the optimization of proton PBS treatment planning for head and neck cancers using policy gradient‐based deep reinforcement learning

Qingqing Wang, Chang Chang

Medical Physics · 2025

DOI: 10.1002/mp.17654 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Medical Physics, 2025. Verfasst von Qingqing Wang und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiation Medicine and Applied Sciences, University of California at San Diego, La Jolla, California, USA. Hauptthemen laut MEDLINE: Radiotherapy Planning, Computer-Assisted, Head and Neck Neoplasms, Proton Therapy, Deep Learning. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 24 Literaturangaben. Gefördert von: Varian Medical Systems.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Proton pencil beam scanning (PBS) treatment planning for head and neck (H&N) cancers is a time‐consuming and experience‐demanding task where a large number of potentially conflicting planning objectives are involved. Deep reinforcement learning (DRL) has recently been introduced to the planning processes of intensity‐modulated radiation therapy (IMRT) and brachytherapy for prostate, lung, and cervical cancers. However, existing DRL planning models are built upon the Q‐learning framework and rely on weighted linear combinations of clinical metrics for reward calculation. These approaches suffer from poor scalability and flexibility, that is, they are only capable of adjusting a limited number of planning objectives in discrete action spaces and therefore fail to generalize to more complex planning problems.

Purpose

Here we propose an automatic treatment planning model using the proximal policy optimization (PPO) algorithm in the policy gradient framework of DRL and a dose distribution‐based reward function for proton PBS treatment planning of H&N cancers.

Methods

The planning process is formulated as an optimization problem. A set of empirical rules is used to create auxiliary planning structures from target volumes and organs‐at‐risk (OARs), along with their associated planning objectives. Special attention is given to overlapping structures with potentially conflicting objectives. These planning objectives are fed into an in‐house optimization engine to generate the spot monitor unit (MU) values. A decision‐making policy network trained using PPO is developed to iteratively adjust the involved planning objective parameters. The policy network predicts actions in a continuous action space and guides the treatment planning system to refine the PBS treatment plans using a novel dose distribution‐based reward function. A total of 34 H&N patients (30 for training and 4 for test) and 26 liver patients (20 for training, 6 for test) are included in this study to train and verify the effectiveness and generalizability of the proposed method.

Results

Proton H&N treatment plans generated by the model show improved OAR sparing with equal or superior target coverage when compared with human‐generated plans. Moreover, additional experiments on liver cancer demonstrate that the proposed method can be successfully generalized to other treatment sites.

Conclusions

The automatic treatment planning model can generate complex H&N plans with quality comparable or superior to those produced by experienced human planners. Compared with existing works, our method is capable of handling more planning objectives in continuous action spaces. To the best of our knowledge, this is the first DRL‐based automatic treatment planning model capable of achieving human‐level performance for H&N cancers.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Radiotherapy Planning, Computer-AssistedHead and Neck NeoplasmsProton TherapyDeep LearningHumansAutomationOrgans at RiskRadiotherapy DosageReinforcement Machine Learning

Stichwörter der Autor:innen

automatic proton PBS treatment planningdeep reinforcement learningpolicy gradient

Autor:innen und Institutionen

  • Department of Radiation Medicine and Applied Sciences, University of California at San Diego, La Jolla, California, USA.
  • California Protons Cancer Therapy Center, San Diego, California, USA.

Förderung

  • Varian Medical Systems

Zitieren

APA

Wang, Q., & Chang, C. (2025). Automating the optimization of proton PBS treatment planning for head and neck cancers using policy gradient‐based deep reinforcement learning. Medical Physics. https://doi.org/10.1002/mp.17654

Vancouver

Wang Q, Chang C. Automating the optimization of proton PBS treatment planning for head and neck cancers using policy gradient‐based deep reinforcement learning. Medical Physics. 2025. doi:10.1002/mp.17654

BibTeX
@article{Wang2025,
  author = {Wang, Qingqing and Chang, Chang},
  title = {Automating the optimization of proton PBS treatment planning for head and neck cancers using policy gradient‐based deep reinforcement learning},
  journal = {Medical Physics},
  year = {2025},
  doi = {10.1002/mp.17654}
}
Kostenlos starten →