A Novel Intelligent Anti-Jamming Algorithm Based on Deep Reinforcement Learning Assisted by Meta-Learning for Wireless Communication Systems
Applied Sciences · 24.11.2023 · 13 (23) · 12642
DOI: 10.3390/app132312642 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 24.11.2023. Verfasst von Qingchuan Chen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
In the field of intelligent anti-jamming, deep reinforcement learning algorithms are regarded as key technical means. However, the learning process of deep reinforcement learning algorithms requires a stable learning environment to ensure its effectiveness. Moreover, the inherent limitations of deep reinforcement learning algorithms mean that they can only demonstrate excellent learning capabilities on specific tasks with constant parameters. When parameters change, they can only resample and relearn to converge. In a changing jamming environment, its stability and convergence speed may be challenged, thereby affecting its robustness and generalization capabilities. Aiming at the naive yet unique similarity characteristics of the communication anti-jamming problem, this paper designs a new Meta-PPO deep reinforcement learning algorithm that combines Proximal Policy Optimization (PPO) and MAML meta-learning ideas. The proposed algorithm engrafts the principle of meta-learning used in the Model Agnostic Meta-Learning (MAML) model onto the Proximal Policy Optimization (PPO)-based schemes, enabling the communication systems to harness its prior learned experiences acquired from previous anti-jamming tasks to facilitate and speed up its optimal decision-making process when faced with incoming jamming attacks with similar features. The proposed algorithm is verified through computer simulation analyses and the results show that the proposed novel Meta-PPO algorithm can outperform traditional DQN- and PPO-based algorithms in terms of better robustness and generalization abilities, which can be used to enhance the anti-jamming capabilities of wireless communication systems.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Chen, Q., Niu, Y., Wan, B., & Xiang, P. (2023). A Novel Intelligent Anti-Jamming Algorithm Based on Deep Reinforcement Learning Assisted by Meta-Learning for Wireless Communication Systems. Applied Sciences, 13(23), 12642. https://doi.org/10.3390/app132312642
Vancouver
Chen Q, Niu Y, Wan B, Xiang P. A Novel Intelligent Anti-Jamming Algorithm Based on Deep Reinforcement Learning Assisted by Meta-Learning for Wireless Communication Systems. Applied Sciences. 2023;13(23):12642. doi:10.3390/app132312642
BibTeX
@article{Chen2023,
author = {Chen, Qingchuan and Niu, Yingtao and Wan, Boyu and Xiang, Peng},
title = {A Novel Intelligent Anti-Jamming Algorithm Based on Deep Reinforcement Learning Assisted by Meta-Learning for Wireless Communication Systems},
journal = {Applied Sciences},
year = {2023},
volume = {13},
number = {23},
pages = {12642},
doi = {10.3390/app132312642}
}
EUVIMED