Proximal Policy Optimization-Based Hierarchical Decision-Making Mechanism for Resource Allocation Optimization in UAV Networks
Electronics · 14.02.2025 · 14 (4) · 747
DOI: 10.3390/electronics14040747 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 14.02.2025. Verfasst von Kun Sun und 4 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Basis Research Plan in Shaanxi Province of China.
Abstract (Originalsprache)
To address the resource allocation problem in dynamic environments where multiple unmanned aerial vehicle base stations (UAV-BSs) provide efficient downlink services to ground users, this paper proposes a novel hierarchical decision-making mechanism based on the Proximal Policy Optimization (PPO) algorithm. The proposed method optimizes time-frequency resource allocation in the downlink, aiming to maximize the total user throughput over multiple time slots. By constructing channel and interference models, the complex multi-channel resource allocation problem is decomposed into a series of single-channel decision subproblems, significantly reducing the action space complexity. Specifically, the original exponential complexity O(NM) (where N is the number of users and M is the number of channels) is reduced to a linear complexity O(N), effectively alleviating the curse of dimensionality. Simulation results demonstrate that the proposed hierarchical architecture, integrated with the PPO algorithm, achieves superior performance in terms of total throughput, convergence speed, and stability compared to existing methods. This study provides new insights and technical support for efficient resource management in UAV-BS systems operating in complex and dynamic environments.
Förderung
- Natural Science Basis Research Plan in Shaanxi Province of China
Zitieren
APA
Sun, K., Yang, J., Li, J., Yang, B., & Ding, S. (2025). Proximal Policy Optimization-Based Hierarchical Decision-Making Mechanism for Resource Allocation Optimization in UAV Networks. Electronics, 14(4), 747. https://doi.org/10.3390/electronics14040747
Vancouver
Sun K, Yang J, Li J, Yang B, Ding S. Proximal Policy Optimization-Based Hierarchical Decision-Making Mechanism for Resource Allocation Optimization in UAV Networks. Electronics. 2025;14(4):747. doi:10.3390/electronics14040747
BibTeX
@article{Sun2025,
author = {Sun, Kun and Yang, Jianyong and Li, Jinglei and Yang, Bo and Ding, Shuman},
title = {Proximal Policy Optimization-Based Hierarchical Decision-Making Mechanism for Resource Allocation Optimization in UAV Networks},
journal = {Electronics},
year = {2025},
volume = {14},
number = {4},
pages = {747},
doi = {10.3390/electronics14040747}
}
EUVIMED