EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Proximal Policy Optimization-Based Hierarchical Decision-Making Mechanism for Resource Allocation Optimization in UAV Networks

Kun Sun, Jianyong Yang, Jinglei Li, Bo Yang, Shuman Ding

Electronics · 2025-02-14 · 14 (4) · 747

DOI: 10.3390/electronics14040747 ↗

At a glance

Journal article in Electronics, published online on 2025-02-14. Written by Kun Sun and 4 co-authors. Cited 15 times so far (Crossref); 23 references. The full text is freely available (open access, CC BY 4.0). Funded by: Natural Science Basis Research Plan in Shaanxi Province of China.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

To address the resource allocation problem in dynamic environments where multiple unmanned aerial vehicle base stations (UAV-BSs) provide efficient downlink services to ground users, this paper proposes a novel hierarchical decision-making mechanism based on the Proximal Policy Optimization (PPO) algorithm. The proposed method optimizes time-frequency resource allocation in the downlink, aiming to maximize the total user throughput over multiple time slots. By constructing channel and interference models, the complex multi-channel resource allocation problem is decomposed into a series of single-channel decision subproblems, significantly reducing the action space complexity. Specifically, the original exponential complexity O(NM) (where N is the number of users and M is the number of channels) is reduced to a linear complexity O(N), effectively alleviating the curse of dimensionality. Simulation results demonstrate that the proposed hierarchical architecture, integrated with the PPO algorithm, achieves superior performance in terms of total throughput, convergence speed, and stability compared to existing methods. This study provides new insights and technical support for efficient resource management in UAV-BS systems operating in complex and dynamic environments.

Funding

  • Natural Science Basis Research Plan in Shaanxi Province of China

Cite

APA

Sun, K., Yang, J., Li, J., Yang, B., & Ding, S. (2025). Proximal Policy Optimization-Based Hierarchical Decision-Making Mechanism for Resource Allocation Optimization in UAV Networks. Electronics, 14(4), 747. https://doi.org/10.3390/electronics14040747

Vancouver

Sun K, Yang J, Li J, Yang B, Ding S. Proximal Policy Optimization-Based Hierarchical Decision-Making Mechanism for Resource Allocation Optimization in UAV Networks. Electronics. 2025;14(4):747. doi:10.3390/electronics14040747

BibTeX
@article{Sun2025,
  author = {Sun, Kun and Yang, Jianyong and Li, Jinglei and Yang, Bo and Ding, Shuman},
  title = {Proximal Policy Optimization-Based Hierarchical Decision-Making Mechanism for Resource Allocation Optimization in UAV Networks},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {4},
  pages = {747},
  doi = {10.3390/electronics14040747}
}
Start for free →