Digital Twin Enhanced Multi-Agent Reinforcement Learning for Large-Scale Mobile Network Coverage Optimization
ACM Transactions on Knowledge Discovery from Data · 31.01.2025 · 19 (1) · 1-23
DOI: 10.1145/3702644 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Knowledge Discovery from Data, online erschienen am 12.12.2024. Verfasst von Haoqiang Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 55 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.
Abstract (Originalsprache)
With the rapid advancement of communication technology and the exponential growth of mobile users, improving network coverage quality and throughput has become increasingly important. In particular, large-scale Base Station (BS) cooperative optimization has become a highly significant topic. BSs can adjust various parameters for high-quality communication, but automating this optimization remains challenging due to environmental sensitivity and interdependencies. Traditional methods for network optimization are constrained by the intricate nature of real-world environments. Further, Reinforcement Learning (RL) techniques, which are effective for configuration policies, encounter difficulties in intricate, high-dimensional wireless communication networks, especially in multi-agent cooperative optimization. To overcome these challenges, this article proposes the Enhanced Multi-Agent Proximal Policy Optimization (EMAPPO), which utilizes the capabilities of the UNet network to extract multi-spatial relationships among a massive number of network elements and employs the DiffPool network to efficiently depict the impact of large-scale action coordination among massive agents on coverage performance. To facilitate evaluation in communication optimization, we further introduce a high-fidelity digital twin-driven mobile network. Extensive experiments validate the effectiveness and superior performance of EMAPPO by utilizing the network digital twin. The results demonstrate significant improvements in signal coverage rate and network throughput compared to the competing methods.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
Zitieren
APA
Liu, H., Su, W., Li, T., Huang, W., & Li, Y. (2025). Digital Twin Enhanced Multi-Agent Reinforcement Learning for Large-Scale Mobile Network Coverage Optimization. ACM Transactions on Knowledge Discovery from Data, 19(1), 1-23. https://doi.org/10.1145/3702644
Vancouver
Liu H, Su W, Li T, Huang W, Li Y. Digital Twin Enhanced Multi-Agent Reinforcement Learning for Large-Scale Mobile Network Coverage Optimization. ACM Transactions on Knowledge Discovery from Data. 2025;19(1):1-23. doi:10.1145/3702644
BibTeX
@article{Liu2025,
author = {Liu, Haoqiang and Su, Weikang and Li, Tong and Huang, Wenzhen and Li, Yong},
title = {Digital Twin Enhanced Multi-Agent Reinforcement Learning for Large-Scale Mobile Network Coverage Optimization},
journal = {ACM Transactions on Knowledge Discovery from Data},
year = {2025},
volume = {19},
number = {1},
pages = {1--23},
doi = {10.1145/3702644}
}
EUVIMED