Distributed Beam-Hopping Scheduling for LEO Mega-Constellation Networks Based on Hierarchical Multi-Agent Deep Reinforcement Learning
IEEE Transactions on Wireless Communications · 2026 · 25 · 12482-12496
DOI: 10.1109/twc.2026.3659941 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2026. Verfasst von Lizeng Gong und 4 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 37 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Hunan Provincial Natural Science Foundation of China.
Abstract (Originalsprache)
Beam hopping (BH) is crucial for managing communication resources in large-scale multi-satellite, multi-beam Low Earth Orbit (LEO) constellation networks. However, achieving high-dynamic multi-satellite cooperative BH in LEO mega-constellations while satisfying multi-dimensional resource allocation demands remains a significant challenge. To address the interdependence of long-term coverage stability and short-term resource volatility, this paper proposes a distributed Beam Hierarchical Multi-Agent Reinforcement Learning (HMARL) framework. Within this framework, a hierarchical Duplex Dueling Multi-agent Q-learning (QPLEX) architecture decouples the high-dimensional joint optimization problem into two tractable layers: satellite-level cell association and beam-level resource scheduling. The former handles coverage planning under load-balancing and interference constraints, while the latter manages dynamic resource allocation amid spatiotemporal traffic variations. Additionally, Chemical Reaction Optimization (CRO) and Cross-Layer Attention (CLA) mechanisms are introduced to address the discrete beam interference problem and the inter-layer information isolation challenge, respectively. Simulation results show that the proposed method, BH-HMARL, performs better than baseline methods. Further results confirm its scalability, with performance remaining stable despite variations in the number of satellites, beams, and cells. Moreover, BH-HMARL achieves real-time scheduling with execution time under 5ms per agent, satisfying slot duration constraints.
Förderung
- National Natural Science Foundation of China
- Hunan Provincial Natural Science Foundation of China
Zitieren
APA
Gong, L., Chen, Q., Yang, L., Yin, Z., & Wang, Y. (2026). Distributed Beam-Hopping Scheduling for LEO Mega-Constellation Networks Based on Hierarchical Multi-Agent Deep Reinforcement Learning. IEEE Transactions on Wireless Communications, 25, 12482-12496. https://doi.org/10.1109/twc.2026.3659941
Vancouver
Gong L, Chen Q, Yang L, Yin Z, Wang Y. Distributed Beam-Hopping Scheduling for LEO Mega-Constellation Networks Based on Hierarchical Multi-Agent Deep Reinforcement Learning. IEEE Transactions on Wireless Communications. 2026;25:12482-12496. doi:10.1109/twc.2026.3659941
BibTeX
@article{Gong2026,
author = {Gong, Lizeng and Chen, Quan and Yang, Lei and Yin, Zhenglong and Wang, Yi},
title = {Distributed Beam-Hopping Scheduling for LEO Mega-Constellation Networks Based on Hierarchical Multi-Agent Deep Reinforcement Learning},
journal = {IEEE Transactions on Wireless Communications},
year = {2026},
volume = {25},
pages = {12482--12496},
doi = {10.1109/twc.2026.3659941}
}
EUVIMED