EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Quadrotor Control Robustness with Multi-Proportional–Integral–Derivative Self-Attention-Guided Deep Reinforcement Learning

Yahui Ren, Feng Zhu, Shuaishuai Sui, Zhengming Yi, Kai Chen

Drones · 10.07.2024 · 8 (7) · 315

DOI: 10.3390/drones8070315 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Drones, online erschienen am 10.07.2024. Verfasst von Yahui Ren und 4 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Hunan Provincial Department of Education Scientific Research Outstanding Youth Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep reinforcement learning has demonstrated flexibility advantages in the control field of quadrotor aircraft. However, when there are sudden disturbances in the environment, especially special disturbances beyond experience, the algorithm often finds it difficult to maintain good control performance. Additionally, due to the randomness in the algorithm’s exploration of states, the model’s improvement efficiency during the training process is low and unstable. To address these issues, we propose a deep reinforcement learning framework guided by Multi-PID Self-Attention to tackle the challenges in the training speed and environmental adaptability of quadrotor aircraft control algorithms. In constructing the simulation experiment environment, we introduce multiple disturbance models to simulate complex situations in the real world. By combining the PID control strategy with deep reinforcement learning and utilizing the multi-head self-attention mechanism to optimize the state reward function in the simulation environment, this framework achieves an efficient and stable training process. This experiment aims to train a quadrotor simulation model to accurately fly to a predetermined position under various disturbance conditions and subsequently maintain a stable hovering state. The experimental results show that, compared with traditional deep reinforcement learning algorithms, this method achieves significant improvements in training efficiency and state exploration ability. At the same time, this study deeply analyzes the application effect of the algorithm in different complex environments, verifies its superior robustness and generalization ability in dealing with environmental disturbances, and provides a new solution for the intelligent control of quadrotor aircraft.

Förderung

  • Hunan Provincial Department of Education Scientific Research Outstanding Youth Project

Zitieren

APA

Ren, Y., Zhu, F., Sui, S., Yi, Z., & Chen, K. (2024). Enhancing Quadrotor Control Robustness with Multi-Proportional–Integral–Derivative Self-Attention-Guided Deep Reinforcement Learning. Drones, 8(7), 315. https://doi.org/10.3390/drones8070315

Vancouver

Ren Y, Zhu F, Sui S, Yi Z, Chen K. Enhancing Quadrotor Control Robustness with Multi-Proportional–Integral–Derivative Self-Attention-Guided Deep Reinforcement Learning. Drones. 2024;8(7):315. doi:10.3390/drones8070315

BibTeX
@article{Ren2024,
  author = {Ren, Yahui and Zhu, Feng and Sui, Shuaishuai and Yi, Zhengming and Chen, Kai},
  title = {Enhancing Quadrotor Control Robustness with Multi-Proportional–Integral–Derivative Self-Attention-Guided Deep Reinforcement Learning},
  journal = {Drones},
  year = {2024},
  volume = {8},
  number = {7},
  pages = {315},
  doi = {10.3390/drones8070315}
}
Kostenlos starten →