Quadrotor Trajectory Tracking Under Multimodal Wind Disturbances via History-Conditioned Hierarchical Distributionally Robust Reinforcement Learning
Drones · 11.11.2026 · 10 (11) · 848
DOI: 10.3390/drones10110848 ↗Kurz gefasst
Fachartikel in der Zeitschrift Drones, online erschienen am 11.11.2026. Verfasst von Junlin Li und 5 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Jiangsu Education Department, Nantong Marine Advanced Research Institute.
Abstract (Originalsprache)
Multimodal wind disturbances complicate quadrotor trajectory tracking through partial observability and shifts in disturbance distributions. To address these challenges, this study develops hierarchically structured distributionally robust proximal policy optimization (HSDR-PPO), integrating observation history with separate Kullback–Leibler constraints on wind-class probabilities and within-class disturbance distributions. The resulting adversarial probabilities weight policy updates while rollout collection maintains fixed candidate coverage, enabling history-conditioned robust control without wind measurements or scenario labels. Simulations using a Crazyflie 2X model with prescribed external forces cover five training seeds and eight test groups. HSDR-PPO achieves the lowest mean episode cost and mean physical failure rate, reducing cost by 13.0–19.2% relative to the best baseline in each group. Under intensity-matched colored-disturbance shifts, worst-decile cost decreases by 32.9% relative to Joint-KL PPO. Ablations support contributions from observation history and hierarchical reweighting, while evaluations under unseen chirps, a figure-eight reference, and an extended task duration demonstrate transfer without retraining. A policy trained in simulation configured for the experimental platform is subsequently deployed on a physical quadrotor, achieving a three-dimensional position root mean square error of 0.071 m in a representative 48 s outdoor flight. These results demonstrate improved robustness under the evaluated simulation conditions and successful deployment for outdoor trajectory tracking.
Förderung
- Jiangsu Education Department
- Nantong Marine Advanced Research Institute
Zitieren
APA
Li, J., Zhang, Y., Yi, J., Chen, C., Ma, T., & Liu, H. (2026). Quadrotor Trajectory Tracking Under Multimodal Wind Disturbances via History-Conditioned Hierarchical Distributionally Robust Reinforcement Learning. Drones, 10(11), 848. https://doi.org/10.3390/drones10110848
Vancouver
Li J, Zhang Y, Yi J, Chen C, Ma T, Liu H. Quadrotor Trajectory Tracking Under Multimodal Wind Disturbances via History-Conditioned Hierarchical Distributionally Robust Reinforcement Learning. Drones. 2026;10(11):848. doi:10.3390/drones10110848
BibTeX
@article{Li2026,
author = {Li, Junlin and Zhang, Yang and Yi, Jie and Chen, Conglin and Ma, Tao and Liu, Hao},
title = {Quadrotor Trajectory Tracking Under Multimodal Wind Disturbances via History-Conditioned Hierarchical Distributionally Robust Reinforcement Learning},
journal = {Drones},
year = {2026},
volume = {10},
number = {11},
pages = {848},
doi = {10.3390/drones10110848}
}
EUVIMED