EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Trajectory Tracking Controller for Quadrotor by Continual Reinforcement Learning in Wind-Disturbed Environment

Yanhui Liu iD, Lina Hao, Shuopeng Wang, Xu Wang

Sensors · 08.08.2025 · 25 (16) · 4895

DOI: 10.3390/s25164895 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 08.08.2025. Verfasst von Yanhui Liu und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110819, China. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The extensive deployment of quadrotors in complex environmental missions has revealed a critical challenge: degradation of trajectory tracking accuracy due to time-varying wind disturbances. Conventional model-based controllers struggle to adapt to nonlinear wind field dynamics, while data-driven approaches often suffer from catastrophic forgetting that compromises environmental adaptability. This paper proposes a reinforcement learning framework with continual adaptation capabilities to enhance robust tracking performance for quadrotors operating in dynamic wind fields. We develop a continual reinforcement learning framework integrating continual backpropagation algorithms with reinforcement learning. Initially, a foundation model is trained in wind-free conditions. When wind disturbance intensity undergoes gradual variations, a neuron utility assessment mechanism dynamically resets inefficient neurons to maintain network plasticity. Concurrently, a multi-objective reward function is designed to improve both training precision and efficiency. The Gazebo/PX4 simulation platform was utilized to validate the wind disturbance stepwise growth and stochastic variations. This approach demonstrated a reduction in the root mean square error of trajectory tracking when compared to the standard PPO algorithm. The proposed framework resolves the plasticity loss problem in deep reinforcement learning through structured neuron resetting, significantly enhancing the continual adaptation capabilities of quadrotors in dynamic wind fields.

Schlagwörter

Stichwörter der Autor:innen

continual learningdeep reinforcement learningquadrotortrajectory tracking control

Autor:innen und Institutionen

  • School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110819, China.

ORCID-Profile: Yanhui Liu

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Liu, Y., Hao, L., Wang, S., & Wang, X. (2025). Trajectory Tracking Controller for Quadrotor by Continual Reinforcement Learning in Wind-Disturbed Environment. Sensors, 25(16), 4895. https://doi.org/10.3390/s25164895

Vancouver

Liu Y, Hao L, Wang S, Wang X. Trajectory Tracking Controller for Quadrotor by Continual Reinforcement Learning in Wind-Disturbed Environment. Sensors. 2025;25(16):4895. doi:10.3390/s25164895

BibTeX
@article{Liu2025,
  author = {Liu, Yanhui and Hao, Lina and Wang, Shuopeng and Wang, Xu},
  title = {Trajectory Tracking Controller for Quadrotor by Continual Reinforcement Learning in Wind-Disturbed Environment},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {16},
  pages = {4895},
  doi = {10.3390/s25164895}
}
Kostenlos starten →