A Real-Time and Optimal Hypersonic Entry Guidance Method Using Inverse Reinforcement Learning
Aerospace · 07.11.2023 · 10 (11) · 948
DOI: 10.3390/aerospace10110948 ↗Kurz gefasst
Fachartikel in der Zeitschrift Aerospace, online erschienen am 07.11.2023. Verfasst von Linfeng Su und 2 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Basic and Applied Basic Research Project of Guangzhou Science and Technology Bureau.
Abstract (Originalsprache)
The mission of hypersonic vehicles faces the problem of highly nonlinear dynamics and complex environments, which presents challenges to the intelligent level and real-time performance of onboard guidance algorithms. In this paper, inverse reinforcement learning is used to address the hypersonic entry guidance problem. The state-control sample pairs and state-rewards sample pairs obtained by interacting with hypersonic entry dynamics are used to train the neural network by applying the distributed proximal policy optimization method. To overcome the sparse reward problem in the hypersonic entry problem, a novel reward function combined with a sophisticated discriminator network is designed to generate dense optimal rewards continuously, which is the main contribution of this paper. The optimized guidance methodology can achieve good terminal accuracy and high success rates with a small number of trajectories as datasets while satisfying heating rate, overload, and dynamic pressure constraints. The proposed guidance method is employed for two typical hypersonic entry vehicles (Common Aero Vehicle-Hypersonic and Reusable Launch Vehicle) to demonstrate the feasibility and potential. Numerical simulation results validate the real-time performance and optimality of the proposed method and indicate its suitability for onboard applications in the hypersonic entry flight.
Förderung
- Basic and Applied Basic Research Project of Guangzhou Science and Technology Bureau
Zitieren
APA
Su, L., Wang, J., & Chen, H. (2023). A Real-Time and Optimal Hypersonic Entry Guidance Method Using Inverse Reinforcement Learning. Aerospace, 10(11), 948. https://doi.org/10.3390/aerospace10110948
Vancouver
Su L, Wang J, Chen H. A Real-Time and Optimal Hypersonic Entry Guidance Method Using Inverse Reinforcement Learning. Aerospace. 2023;10(11):948. doi:10.3390/aerospace10110948
BibTeX
@article{Su2023,
author = {Su, Linfeng and Wang, Jinbo and Chen, Hongbo},
title = {A Real-Time and Optimal Hypersonic Entry Guidance Method Using Inverse Reinforcement Learning},
journal = {Aerospace},
year = {2023},
volume = {10},
number = {11},
pages = {948},
doi = {10.3390/aerospace10110948}
}
EUVIMED