EUVIMEDEUVIMED entdecken
Crossref

Deep Reinforcement Learning for Dynamic Spectrum Access: Convergence Analysis and System Design

Ramin Safavinejad, Hao-Hsuan Chang, Lingjia Liu

IEEE Transactions on Wireless Communications · 2024-12 · 23 (12) · 18888-18902

DOI: 10.1109/twc.2024.3414428 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2024-12. Verfasst von Ramin Safavinejad und 2 weiteren Autor:innen. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: U.S. National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In dynamic spectrum access (DSA) networks, secondary users (SUs) need to opportunistically access primary users’ (PUs) radio spectrum without causing significant interference. Since the SU-PU interaction is limited, deep reinforcement learning has been introduced to help SUs conduct spectrum access. Specifically, deep recurrent Q network (DRQN) has been utilized in DSA networks for SUs to aggregate information from recent experiences to make spectrum access decisions. DRQN is notorious for its sample efficiency since it needs a rather large number of training samples to tune its parameters which is a computationally demanding task. Deep echo state network (DEQN) has been introduced for DSA networks to address the sample efficiency issue of DRQN. In this work, we compare the convergence of DRQN and DEQN by comparing the upper bounds we obtain on their covering number, a notion of richness. Furthermore, we introduce a method to determine the right hyper-parameters for DEQN, providing system design guidance for DEQN-based DSA networks. Extensive performance evaluation confirms that DEQN-based DSA strategy is the superior choice with regard to computational power while outperforming DRQN-based ones.

Förderung

  • U.S. National Science Foundation

Zitieren

APA

Safavinejad, R., Chang, H., & Liu, L. (2024). Deep Reinforcement Learning for Dynamic Spectrum Access: Convergence Analysis and System Design. IEEE Transactions on Wireless Communications, 23(12), 18888-18902. https://doi.org/10.1109/twc.2024.3414428

Vancouver

Safavinejad R, Chang H, Liu L. Deep Reinforcement Learning for Dynamic Spectrum Access: Convergence Analysis and System Design. IEEE Transactions on Wireless Communications. 2024;23(12):18888-18902. doi:10.1109/twc.2024.3414428

BibTeX
@article{Safavinejad2024,
  author = {Safavinejad, Ramin and Chang, Hao-Hsuan and Liu, Lingjia},
  title = {Deep Reinforcement Learning for Dynamic Spectrum Access: Convergence Analysis and System Design},
  journal = {IEEE Transactions on Wireless Communications},
  year = {2024},
  volume = {23},
  number = {12},
  pages = {18888--18902},
  doi = {10.1109/twc.2024.3414428}
}
Kostenlos starten →