EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Safe Reinforcement Learning for Transition Control of Ducted-Fan UAVs

Yanbo Fu, Wenjie Zhao, Liu Liu

Drones · 22.05.2023 · 7 (5) · 332

DOI: 10.3390/drones7050332 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Drones, online erschienen am 22.05.2023. Verfasst von Yanbo Fu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the 1912 project, the Key Research and Development Program of Zhejiang Province, China, the Fundamental Research Funds for the Central Universities, China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Ducted-fan tail-sitter unmanned aerial vehicles (UAVs) provide versatility and unique benefits, attracting significant attention in various applications. This study focuses on developing a safe reinforcement learning method for back-transition control between level flight mode and hover mode for ducted-fan tail-sitter UAVs. Our method enables transition control with a minimal altitude change and transition time while adhering to the velocity constraint. We employ the Trust Region Policy Optimization, Proximal Policy Optimization with Lagrangian, and Constrained Policy Optimization (CPO) algorithms for controller training, showcasing the superiority of the CPO algorithm and the necessity of the velocity constraint. The transition trajectory achieved using the CPO algorithm closely resembles the optimal trajectory obtained via the well-known GPOPS-II software with the SNOPT solver. Meanwhile, the CPO algorithm also exhibits strong robustness under unknown perturbations of UAV model parameters and wind disturbance.

Förderung

  • the 1912 project, the Key Research and Development Program of Zhejiang Province, China
  • the Fundamental Research Funds for the Central Universities, China

Zitieren

APA

Fu, Y., Zhao, W., & Liu, L. (2023). Safe Reinforcement Learning for Transition Control of Ducted-Fan UAVs. Drones, 7(5), 332. https://doi.org/10.3390/drones7050332

Vancouver

Fu Y, Zhao W, Liu L. Safe Reinforcement Learning for Transition Control of Ducted-Fan UAVs. Drones. 2023;7(5):332. doi:10.3390/drones7050332

BibTeX
@article{Fu2023,
  author = {Fu, Yanbo and Zhao, Wenjie and Liu, Liu},
  title = {Safe Reinforcement Learning for Transition Control of Ducted-Fan UAVs},
  journal = {Drones},
  year = {2023},
  volume = {7},
  number = {5},
  pages = {332},
  doi = {10.3390/drones7050332}
}
Kostenlos starten →