EUVIMEDEUVIMED entdecken
Crossref

Target Tracking Control of UAV Through Deep Reinforcement Learning

Bodi Ma, Zhenbao Liu, Wen Zhao, Jinbiao Yuan, Hao Long, Xiao Wang, Zhirong Yuan

IEEE Transactions on Intelligent Transportation Systems · 2023-06 · 24 (6) · 5983-6000

DOI: 10.1109/tits.2023.3249900 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2023-06. Verfasst von Bodi Ma und 6 weiteren Autor:innen. Die Arbeit wurde bisher 97-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: National Natural Science Foundation Fund, Key Research and Development Program of Shaanxi Province, Shenzhen Fundamental Research Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study presents an innovative reinforcement-learning-based control algorithm for a vertical take-off and landing (VTOL) aircraft under wind disturbances. In our approach, the tracking control problem of the VTOL aircraft is formulated as a Markov decision process, and the appropriate system state, reward function, and soft update method are presented. To improve the control accuracy under wind disturbances, three kinds of wind fields were added in the learning environment to expand the exploration space and simulate the effect of wind disturbances on the flight control. Moreover, to ensure the tracking accuracy and the practical implementation, a quantum-inspired experience replay strategy was developed based on quantum computation theory. In this strategy, the preparation operation scheme was designed to encourage the exploration and speed up the convergence. The depreciation operation method was developed to enrich the sample diversity, which increased the robustness of the controller and allowed the control strategy learned in the numerical simulations to be directly transferred into real-world environments. Numerical simulations, hardware-in-the-loop experiments, and real-world flight experiments were conducted to evaluate the performance and merits of the proposed method. The results demonstrated high accuracy and effectiveness and good robustness of the proposed control algorithm in terms of standoff target tracking control and flight stability.

Förderung

  • National Natural Science Foundation Fund
  • Key Research and Development Program of Shaanxi Province
  • Shenzhen Fundamental Research Program
  • Aeronautical Science Foundation of China
  • Beijing Institute of Spacecraft System Engineering Research Project
  • Innovation Foundation for Doctor Dissertation of Northwestern Polytechnical University
  • Basic Research Program of Taicang
  • Natural Science Foundation of Shaanxi Province

Zitieren

APA

Ma, B., Liu, Z., Zhao, W., Yuan, J., Long, H., Wang, X., & Yuan, Z. (2023). Target Tracking Control of UAV Through Deep Reinforcement Learning. IEEE Transactions on Intelligent Transportation Systems, 24(6), 5983-6000. https://doi.org/10.1109/tits.2023.3249900

Vancouver

Ma B, Liu Z, Zhao W, Yuan J, Long H, Wang X, et al. Target Tracking Control of UAV Through Deep Reinforcement Learning. IEEE Transactions on Intelligent Transportation Systems. 2023;24(6):5983-6000. doi:10.1109/tits.2023.3249900

BibTeX
@article{Ma2023,
  author = {Ma, Bodi and Liu, Zhenbao and Zhao, Wen and Yuan, Jinbiao and Long, Hao and Wang, Xiao and Yuan, Zhirong},
  title = {Target Tracking Control of UAV Through Deep Reinforcement Learning},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2023},
  volume = {24},
  number = {6},
  pages = {5983--6000},
  doi = {10.1109/tits.2023.3249900}
}
Kostenlos starten →