EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Intelligent Ascent Trajectory Optimization via Behavioral Cloning‐Augmented Reinforcement Learning From Demonstrations

Qingji Jiang, Xiaogang Wang, Bin E, Ningyu Wang

International Journal of Aerospace Engineering · 2026-01 · 2026 (1)

DOI: 10.1155/ijae/7263139 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Aerospace Engineering, online erschienen am 07.08.2026. Verfasst von Qingji Jiang und 3 weiteren Autor:innen. Die Arbeit nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional ascent trajectory optimization methods for hypersonic vehicles suffer from a high computational burden. This paper proposes an intelligent optimization algorithm based on deep reinforcement learning, where the offline‐trained neural network enables fast trajectory generation and online deployment while maintaining all terminal, control, and path constraints. First, the trajectory optimization model—including ascent dynamics, program angle form, and multiple constraints—is established. Then, the trajectory optimization problem is formulated as a Markov decision process, rendering it solvable by reinforcement learning. To accelerate training, the twin delayed deep deterministic policy gradient (TD3) algorithm is improved via behavioral cloning and learning from demonstrations (fD). Specifically, an expert policy is pretrained via behavioral cloning from the optimization dataset, which can warm‐start the TD3′s Actor. As a result, the early‐stage exploration for successful samples is effectively enhanced. Additionally, a supervised auxiliary loss is incorporated into the Actor′s update to strengthen the reward signal and improve TD3 convergence. Finally, simulations demonstrate that the proposed behavioral cloning‐augmented TD3 from demonstrations (BC‐TD3fD) algorithm converges rapidly, whereas the original TD3 fails. Compared with standard baselines, BC‐TD3fD reduces the average offline optimization time from 19.268 to 0.149 s, achieving a substantial acceleration over sequential quadratic programming, and decreases the online per‐step computation time to 3.204 ms, representing a 94.2% reduction relative to model predictive control based on quadratic programming, thereby ensuring deterministic real‐time performance.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Jiang, Q., Wang, X., E, B., & Wang, N. (2026). Intelligent Ascent Trajectory Optimization via Behavioral Cloning‐Augmented Reinforcement Learning From Demonstrations. International Journal of Aerospace Engineering, 2026(1). https://doi.org/10.1155/ijae/7263139

Vancouver

Jiang Q, Wang X, E B, Wang N. Intelligent Ascent Trajectory Optimization via Behavioral Cloning‐Augmented Reinforcement Learning From Demonstrations. International Journal of Aerospace Engineering. 2026;2026(1). doi:10.1155/ijae/7263139

BibTeX
@article{Jiang2026,
  author = {Jiang, Qingji and Wang, Xiaogang and E, Bin and Wang, Ningyu},
  title = {Intelligent Ascent Trajectory Optimization via Behavioral Cloning‐Augmented Reinforcement Learning From Demonstrations},
  journal = {International Journal of Aerospace Engineering},
  year = {2026},
  volume = {2026},
  number = {1},
  doi = {10.1155/ijae/7263139}
}
Kostenlos starten →