Application of Reinforcement Learning in Deep-Stall Recovery
IEEE Transactions on Aerospace and Electronic Systems · 2025-08 · 61 (4) · 10581-10594
DOI: 10.1109/taes.2025.3561100 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Aerospace and Electronic Systems, 2025-08. Verfasst von Ruichen Ming und 4 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 29 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Aeronautical Science Foundation of China.
Abstract (Originalsprache)
The aircraft deep-stall phenomenon is caused by an angle of attack (AOA) that stabilizes at an equilibrium point of high AOA. This excessive AOA leads to a reduction in the lift, as well as a decrease in the elevator efficiency, making it difficult to recover the aircraft out of this very dangerous flight condition. Reinforcement learning (RL) methods offer a design approach for such complex nonlinear control problems. However, during deep-stall recovery tasks, the nonlinearity of the aircraft model is high, and the control efficiency is substantially reduced, hence limiting the application of direct RL methods. To address this problem, we conduct bifurcation and phase plane analyses on the deep-stall model of the aircraft, and use the results as domain knowledge to construct the reward function. Then, we apply the proximal policy optimization algorithm to the deep-stall strategy. Finally, in the simulation, we compare the method with feedback shaping with the RL method without feedback shaping. The simulation results indicate that although the former method recovers the aircraft at the AOA, its uncontrollable state renders this an unsuccessful recovery. Meanwhile, the proposed method stably performs deep-stall recovery tasks through a loop maneuver.
Förderung
- National Natural Science Foundation of China
- Aeronautical Science Foundation of China
Zitieren
APA
Ming, R., Liu, X., Xu, X., Li, Y., & Zhang, W. (2025). Application of Reinforcement Learning in Deep-Stall Recovery. IEEE Transactions on Aerospace and Electronic Systems, 61(4), 10581-10594. https://doi.org/10.1109/taes.2025.3561100
Vancouver
Ming R, Liu X, Xu X, Li Y, Zhang W. Application of Reinforcement Learning in Deep-Stall Recovery. IEEE Transactions on Aerospace and Electronic Systems. 2025;61(4):10581-10594. doi:10.1109/taes.2025.3561100
BibTeX
@article{Ming2025,
author = {Ming, Ruichen and Liu, Xiaoxiong and Xu, Xinlong and Li, Yu and Zhang, Weiguo},
title = {Application of Reinforcement Learning in Deep-Stall Recovery},
journal = {IEEE Transactions on Aerospace and Electronic Systems},
year = {2025},
volume = {61},
number = {4},
pages = {10581--10594},
doi = {10.1109/taes.2025.3561100}
}
EUVIMED