Intelligent Ascent Trajectory Optimization via Behavioral Cloning‐Augmented Reinforcement Learning From Demonstrations
International Journal of Aerospace Engineering · 2026-01 · 2026 (1)
DOI: 10.1155/ijae/7263139 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Aerospace Engineering, online erschienen am 07.08.2026. Verfasst von Qingji Jiang und 3 weiteren Autor:innen. Die Arbeit nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Traditional ascent trajectory optimization methods for hypersonic vehicles suffer from a high computational burden. This paper proposes an intelligent optimization algorithm based on deep reinforcement learning, where the offline‐trained neural network enables fast trajectory generation and online deployment while maintaining all terminal, control, and path constraints. First, the trajectory optimization model—including ascent dynamics, program angle form, and multiple constraints—is established. Then, the trajectory optimization problem is formulated as a Markov decision process, rendering it solvable by reinforcement learning. To accelerate training, the twin delayed deep deterministic policy gradient (TD3) algorithm is improved via behavioral cloning and learning from demonstrations (fD). Specifically, an expert policy is pretrained via behavioral cloning from the optimization dataset, which can warm‐start the TD3′s Actor. As a result, the early‐stage exploration for successful samples is effectively enhanced. Additionally, a supervised auxiliary loss is incorporated into the Actor′s update to strengthen the reward signal and improve TD3 convergence. Finally, simulations demonstrate that the proposed behavioral cloning‐augmented TD3 from demonstrations (BC‐TD3fD) algorithm converges rapidly, whereas the original TD3 fails. Compared with standard baselines, BC‐TD3fD reduces the average offline optimization time from 19.268 to 0.149 s, achieving a substantial acceleration over sequential quadratic programming, and decreases the online per‐step computation time to 3.204 ms, representing a 94.2% reduction relative to model predictive control based on quadratic programming, thereby ensuring deterministic real‐time performance.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Jiang, Q., Wang, X., E, B., & Wang, N. (2026). Intelligent Ascent Trajectory Optimization via Behavioral Cloning‐Augmented Reinforcement Learning From Demonstrations. International Journal of Aerospace Engineering, 2026(1). https://doi.org/10.1155/ijae/7263139
Vancouver
Jiang Q, Wang X, E B, Wang N. Intelligent Ascent Trajectory Optimization via Behavioral Cloning‐Augmented Reinforcement Learning From Demonstrations. International Journal of Aerospace Engineering. 2026;2026(1). doi:10.1155/ijae/7263139
BibTeX
@article{Jiang2026,
author = {Jiang, Qingji and Wang, Xiaogang and E, Bin and Wang, Ningyu},
title = {Intelligent Ascent Trajectory Optimization via Behavioral Cloning‐Augmented Reinforcement Learning From Demonstrations},
journal = {International Journal of Aerospace Engineering},
year = {2026},
volume = {2026},
number = {1},
doi = {10.1155/ijae/7263139}
}
EUVIMED