Multi-Agent Q-Learning for Real-Time Load Balancing User Association and Handover in Mobile Networks
IEEE Transactions on Wireless Communications · 2024-08 · 23 (8) · 9001-9015
DOI: 10.1109/twc.2024.3357702 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2024-08. Verfasst von Alireza Alizadeh und 2 weiteren Autor:innen. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 33 Literaturangaben. Gefördert von: National Science Foundation under the Division of Computer and Network Systems (CNS), Spectrum and Wireless Innovation enabled by Future Technologies (SWIFT) p….
Themen: Übergabe
Abstract (Originalsprache)
As next generation cellular networks become denser, associating users with the optimal base stations at each time while ensuring no base station is overloaded becomes critical for achieving stable and high network performance. We propose multi-agent online Q-learning (QL) algorithms for performing real-time load balancing user association and handover in dense cellular networks. The load balancing constraints at all base stations couple the actions of user agents, and we propose two multi-agent action selection policies, one centralized and one distributed, to satisfy load balancing at every learning step. In the centralized policy, the actions of UEs are determined by a central load balancer (CLB) running an algorithm based on swapping the worst connection to maximize the total learning reward. In the distributed policy, each UE takes an action based on its local information by participating in a distributed matching game with the BSs to maximize the local reward. We then integrate these action selection policies into an online QL algorithm that adapts in real-time to network dynamics including channel variations and user mobility, using a reward function that considers a handover cost to reduce handover frequency. The proposed multi-agent QL algorithm features low-complexity and fast convergence, outperforming 3GPP max-SINR association. Both policies adapt well to network dynamics at various UE speed profiles from walking, running, to biking and suburban driving, illustrating their robustness and real-time adaptability.
Förderung
- National Science Foundation under the Division of Computer and Network Systems (CNS), Spectrum and Wireless Innovation enabled by Future Technologies (SWIFT) p…
Zitieren
APA
Alizadeh, A., Lim, B., & Vu, M. (2024). Multi-Agent Q-Learning for Real-Time Load Balancing User Association and Handover in Mobile Networks. IEEE Transactions on Wireless Communications, 23(8), 9001-9015. https://doi.org/10.1109/twc.2024.3357702
Vancouver
Alizadeh A, Lim B, Vu M. Multi-Agent Q-Learning for Real-Time Load Balancing User Association and Handover in Mobile Networks. IEEE Transactions on Wireless Communications. 2024;23(8):9001-9015. doi:10.1109/twc.2024.3357702
BibTeX
@article{Alizadeh2024,
author = {Alizadeh, Alireza and Lim, Byungju and Vu, Mai},
title = {Multi-Agent Q-Learning for Real-Time Load Balancing User Association and Handover in Mobile Networks},
journal = {IEEE Transactions on Wireless Communications},
year = {2024},
volume = {23},
number = {8},
pages = {9001--9015},
doi = {10.1109/twc.2024.3357702}
}
EUVIMED