Trajectory Tracking Controller for Quadrotor by Continual Reinforcement Learning in Wind-Disturbed Environment
Sensors · 08.08.2025 · 25 (16) · 4895
DOI: 10.3390/s25164895 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 08.08.2025. Verfasst von Yanhui Liu und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110819, China. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
The extensive deployment of quadrotors in complex environmental missions has revealed a critical challenge: degradation of trajectory tracking accuracy due to time-varying wind disturbances. Conventional model-based controllers struggle to adapt to nonlinear wind field dynamics, while data-driven approaches often suffer from catastrophic forgetting that compromises environmental adaptability. This paper proposes a reinforcement learning framework with continual adaptation capabilities to enhance robust tracking performance for quadrotors operating in dynamic wind fields. We develop a continual reinforcement learning framework integrating continual backpropagation algorithms with reinforcement learning. Initially, a foundation model is trained in wind-free conditions. When wind disturbance intensity undergoes gradual variations, a neuron utility assessment mechanism dynamically resets inefficient neurons to maintain network plasticity. Concurrently, a multi-objective reward function is designed to improve both training precision and efficiency. The Gazebo/PX4 simulation platform was utilized to validate the wind disturbance stepwise growth and stochastic variations. This approach demonstrated a reduction in the root mean square error of trajectory tracking when compared to the standard PPO algorithm. The proposed framework resolves the plasticity loss problem in deep reinforcement learning through structured neuron resetting, significantly enhancing the continual adaptation capabilities of quadrotors in dynamic wind fields.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110819, China.
ORCID-Profile: Yanhui Liu
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Liu, Y., Hao, L., Wang, S., & Wang, X. (2025). Trajectory Tracking Controller for Quadrotor by Continual Reinforcement Learning in Wind-Disturbed Environment. Sensors, 25(16), 4895. https://doi.org/10.3390/s25164895
Vancouver
Liu Y, Hao L, Wang S, Wang X. Trajectory Tracking Controller for Quadrotor by Continual Reinforcement Learning in Wind-Disturbed Environment. Sensors. 2025;25(16):4895. doi:10.3390/s25164895
BibTeX
@article{Liu2025,
author = {Liu, Yanhui and Hao, Lina and Wang, Shuopeng and Wang, Xu},
title = {Trajectory Tracking Controller for Quadrotor by Continual Reinforcement Learning in Wind-Disturbed Environment},
journal = {Sensors},
year = {2025},
volume = {25},
number = {16},
pages = {4895},
doi = {10.3390/s25164895}
}
EUVIMED