EUVIMEDEUVIMED entdecken
Crossref

Multi-Agent Reinforcement Learning With Policy Clipping and Average Evaluation for UAV-Assisted Communication Markov Game

Zikai Feng, Mengxing Huang, Di Wu, Edmond Q. Wu, Chau Yuen

IEEE Transactions on Intelligent Transportation Systems · 2023-12 · 24 (12) · 14281-14293

DOI: 10.1109/tits.2023.3296769 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2023-12. Verfasst von Zikai Feng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: Scientific Research Fund Project of Hainan University, Natural Science Foundation of Hainan Province, Hainan Provincial Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Unmanned aerial vehicle (UAV)-assisted communication is a significant technology in 6G communication. In order to cope with the dynamic trajectory optimization problem of the air-ground network, the interaction between entities is modeled as a Markov game firstly. Then, the model-free multi-agent reinforcement learning (MARL) is adopted to optimize individual decision-making. This enables agents to learn the mobile patterns of others, so as to optimize their own mobile strategy. However, there are some common issues when executing the benchmark MARL algorithms, such as biased estimation and local optimum. To solve these problems, an enhanced multi-agent proximal policy optimization algorithm is proposed with policy clipping and average evaluation to guarantee the fast convergence and accurate estimation. Simulations demonstrate that this method produces superior convergence than the benchmark algorithms. It allows the UAV base station, ground users and the aerial jammer to adopt the optimal mobile strategies to achieve their respective maximum cumulative rewards. In addition, the stable strategies of agents constitute the approximate Nash equilibrium for the UAV-assisted communication Markov Game.

Förderung

  • Scientific Research Fund Project of Hainan University
  • Natural Science Foundation of Hainan Province
  • Hainan Provincial Natural Science Foundation of China
  • National Natural Science Foundation of China
  • State Scholarship Fund, China Scholarship Council

Zitieren

APA

Feng, Z., Huang, M., Wu, D., Wu, E. Q., & Yuen, C. (2023). Multi-Agent Reinforcement Learning With Policy Clipping and Average Evaluation for UAV-Assisted Communication Markov Game. IEEE Transactions on Intelligent Transportation Systems, 24(12), 14281-14293. https://doi.org/10.1109/tits.2023.3296769

Vancouver

Feng Z, Huang M, Wu D, Wu EQ, Yuen C. Multi-Agent Reinforcement Learning With Policy Clipping and Average Evaluation for UAV-Assisted Communication Markov Game. IEEE Transactions on Intelligent Transportation Systems. 2023;24(12):14281-14293. doi:10.1109/tits.2023.3296769

BibTeX
@article{Feng2023,
  author = {Feng, Zikai and Huang, Mengxing and Wu, Di and Wu, Edmond Q. and Yuen, Chau},
  title = {Multi-Agent Reinforcement Learning With Policy Clipping and Average Evaluation for UAV-Assisted Communication Markov Game},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2023},
  volume = {24},
  number = {12},
  pages = {14281--14293},
  doi = {10.1109/tits.2023.3296769}
}
Kostenlos starten →