EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Reinforcement Learning Stabilization for Quadrotor UAVs via Lipschitz-Constrained Policy Regularization

Jiale Quan, Weijun Hu, Xianlong Ma, Gang Chen

Drones · 26.09.2025 · 9 (10) · 675

DOI: 10.3390/drones9100675 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Drones, online erschienen am 26.09.2025. Verfasst von Jiale Quan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Reinforcement learning (RL), and in particular Proximal Policy Optimization (PPO), has shown promise in high-precision quadrotor unmanned aerial vehicle (QUAV) control. However, the performance of PPO is highly sensitive to the choice of the clipping parameter, and inappropriate settings can lead to unstable training dynamics and excessive policy oscillations, which limit deployment in safety-critical aerial applications. To address this issue, we propose a stability-aware dynamic clipping parameter adjustment strategy, which adapts the clipping threshold ϵt in real time based on a stability variance metric St. This adaptive mechanism balances exploration and stability throughout the training process. Furthermore, we provide a Lipschitz continuity interpretation of the clipping mechanism, showing that its adaptation implicitly adjusts a bound on the policy update step, thereby offering a deterministic guarantee on the oscillation magnitude. Extensive simulation results demonstrate that the proposed method reduces policy variance by 45% and accelerates convergence compared to baseline PPO, resulting in smoother control responses and improved robustness under dynamic operating conditions. While developed within the PPO framework, the proposed approach is readily applicable to other on policy policy gradient methods.

Zitieren

APA

Quan, J., Hu, W., Ma, X., & Chen, G. (2025). Reinforcement Learning Stabilization for Quadrotor UAVs via Lipschitz-Constrained Policy Regularization. Drones, 9(10), 675. https://doi.org/10.3390/drones9100675

Vancouver

Quan J, Hu W, Ma X, Chen G. Reinforcement Learning Stabilization for Quadrotor UAVs via Lipschitz-Constrained Policy Regularization. Drones. 2025;9(10):675. doi:10.3390/drones9100675

BibTeX
@article{Quan2025,
  author = {Quan, Jiale and Hu, Weijun and Ma, Xianlong and Chen, Gang},
  title = {Reinforcement Learning Stabilization for Quadrotor UAVs via Lipschitz-Constrained Policy Regularization},
  journal = {Drones},
  year = {2025},
  volume = {9},
  number = {10},
  pages = {675},
  doi = {10.3390/drones9100675}
}
Kostenlos starten →