Optimization for Dynamic Laser Inter-Satellite Link Scheduling With Routing: A Multi-Agent Deep Reinforcement Learning Approach
IEEE Transactions on Communications · 2024-05 · 72 (5) · 2762-2778
DOI: 10.1109/tcomm.2023.3347775 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Communications, 2024-05. Verfasst von Guanhua Wang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 41-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Science Foundation, Toyota and Amazon, Science, Technology and Innovation Commission of Shenzhen Municipality.
Abstract (Originalsprache)
Laser inter-satellite links (LISLs) have greatly extended communication distance between satellites, allowing for establishment of dynamic links to reduce communication delay. However, a closed-loop control is required for LISL, which causes high energy consumption. Proper scheduling of dynamic LISLs can effectively reduce energy consumption and communication delay. In this study, a satellite link mode with three fixed LISLs and one dynamic LISL is designed, and its feasibility is analyzed. The optimization problem is formulated and transformed into a Markov decision process (MDP) by modeling it as a sequential decision problem. By decomposing states, actions, and reward functions, the MDP is divided into the proposed multi-agent deep reinforcement learning (MADRL). Moreover, compressed sensing is utilized to cut down state information to reduce communication, storage, and computation overhead. Furthermore, network parameters and experience sharing, and prioritized experience replay have been adopted to improve stability and convergence speed of network training with a large number of agents. Experimental results show that under different routing strategies, the proposed MADRL can reduce energy consumption by over 15% and delay by approximately two hops compared to fixed LISLs scenario within several iterations.
Förderung
- National Science Foundation
- Toyota and Amazon
- Science, Technology and Innovation Commission of Shenzhen Municipality
- National Key Research and Development Program of China
Zitieren
APA
Wang, G., Yang, F., Song, J., & Han, Z. (2024). Optimization for Dynamic Laser Inter-Satellite Link Scheduling With Routing: A Multi-Agent Deep Reinforcement Learning Approach. IEEE Transactions on Communications, 72(5), 2762-2778. https://doi.org/10.1109/tcomm.2023.3347775
Vancouver
Wang G, Yang F, Song J, Han Z. Optimization for Dynamic Laser Inter-Satellite Link Scheduling With Routing: A Multi-Agent Deep Reinforcement Learning Approach. IEEE Transactions on Communications. 2024;72(5):2762-2778. doi:10.1109/tcomm.2023.3347775
BibTeX
@article{Wang2024,
author = {Wang, Guanhua and Yang, Fang and Song, Jian and Han, Zhu},
title = {Optimization for Dynamic Laser Inter-Satellite Link Scheduling With Routing: A Multi-Agent Deep Reinforcement Learning Approach},
journal = {IEEE Transactions on Communications},
year = {2024},
volume = {72},
number = {5},
pages = {2762--2778},
doi = {10.1109/tcomm.2023.3347775}
}
EUVIMED