EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Dynamic soaring in UAVs: a deep reinforcement learning approach

Mishma Akhtar, Adnan Maqsood, Imran Mir, Baris Gungordu

The Aeronautical Journal · 2026-07 · 130 (1349) · 2343-2371

DOI: 10.1017/aer.2026.10155 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Aeronautical Journal, online erschienen am 07.04.2026. Verfasst von Mishma Akhtar und 3 weiteren Autor:innen. Die Arbeit nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Dynamic soaring (DS) enables unmanned aerial vehicles (UAVs) to extend endurance by extracting energy from atmospheric wind gradients. While prior DS research has primarily focused on fixed-wing platforms using nonlinear optimal control and trajectory optimisation, these methods typically require solving computationally demanding optimisation problems online. In contrast, deep reinforcement learning (DRL) allows computationally intensive training to be performed offline, with real-time deployment requiring only lightweight policy inference. This study investigates autonomous dynamic soaring in a hybrid tricopter UAV, where the two forward-facing rotors provide limited thrust assistance and the rear rotor remains inactive during soaring. A six-degree-of-freedom nonlinear flight model is implemented in MATLAB/Simulink to capture aerodynamic forces and wind-gradient energy interactions. The DS task is formulated as a DRL problem, and three representative algorithms – DDPG, PPO and TRPO – are evaluated. Simulation results demonstrate distinct performance characteristics: proximal policy optimisation (PPO) yields the most stable and repeatable cycles, trust region policy optimisation (TRPO) produces smoother control inputs, and deep deterministic policy gradient (DDPG) converges rapidly but relies more heavily on propulsive thrust. Compared to DDPG, TRPO and PPO improve net energy gain by approximately 42.0% and 30.3%, respectively. These findings demonstrate the feasibility of DS in a tricopter-based hybrid UAV and highlight DRL as an effective framework for autonomous, energy-aware flight.

Zitieren

APA

Akhtar, M., Maqsood, A., Mir, I., & Gungordu, B. (2026). Dynamic soaring in UAVs: a deep reinforcement learning approach. The Aeronautical Journal, 130(1349), 2343-2371. https://doi.org/10.1017/aer.2026.10155

Vancouver

Akhtar M, Maqsood A, Mir I, Gungordu B. Dynamic soaring in UAVs: a deep reinforcement learning approach. The Aeronautical Journal. 2026;130(1349):2343-2371. doi:10.1017/aer.2026.10155

BibTeX
@article{Akhtar2026,
  author = {Akhtar, Mishma and Maqsood, Adnan and Mir, Imran and Gungordu, Baris},
  title = {Dynamic soaring in UAVs: a deep reinforcement learning approach},
  journal = {The Aeronautical Journal},
  year = {2026},
  volume = {130},
  number = {1349},
  pages = {2343--2371},
  doi = {10.1017/aer.2026.10155}
}
Kostenlos starten →