Asynchronous Multi-Agent Reinforcement Learning Aided Packet-Routing for Space-Air-Ground Integrated Networks
IEEE Transactions on Mobile Computing · 2026-12 · 25 (12) · 23418-23434
DOI: 10.1109/tmc.2026.3727501 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2026-12. Verfasst von Dong Liu und 4 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Open Research Project of the State Key Laboratory of Internet Architecture, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
Routing in space-air-ground integrated networks (SAGIN) is highly challenging due to rapidly varying topology, cross-layer coupling, and inherently asynchronous operations that jointly cause severe fluctuations in link quality and end-to-end (E2E) performance. To address these challenges, this paper proposes Asynchronous Multi-agent Graph-based Routing (AMG-routing), an asynchronous multi-agent reinforcement learning (AMARL) framework for routing optimization in SAGIN. Unlike conventional synchronous MARL approaches that rely on globally aligned decision steps, AMG-routing formulates routing as a macro-action decentralized partially observable Markov decision process (MacDec-POMDP), enabling fully decentralized and event-driven coordination among heterogeneous nodes. A permutation-equivariant (PE) graph neural network (GNN)-based Q-network is further developed to ensure order-consistent neighbor-action mappings and improve policy generalization under dynamic topology variations. Moreover, cross-layer features reflecting queueing, MAC contention, and channel occupancy are incorporated into the observation space to capture dominant delay contributors. Simulation results demonstrate that AMG-routing consistently outperforms traditional and state-of-the-art MARL/GNN-based routing schemes in terms of E2E delay and throughput.
Förderung
- National Natural Science Foundation of China
- Open Research Project of the State Key Laboratory of Internet Architecture
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Liu, D., Jian, L., Ma, J., Situ, J., & Bai, L. (2026). Asynchronous Multi-Agent Reinforcement Learning Aided Packet-Routing for Space-Air-Ground Integrated Networks. IEEE Transactions on Mobile Computing, 25(12), 23418-23434. https://doi.org/10.1109/tmc.2026.3727501
Vancouver
Liu D, Jian L, Ma J, Situ J, Bai L. Asynchronous Multi-Agent Reinforcement Learning Aided Packet-Routing for Space-Air-Ground Integrated Networks. IEEE Transactions on Mobile Computing. 2026;25(12):23418-23434. doi:10.1109/tmc.2026.3727501
BibTeX
@article{Liu2026,
author = {Liu, Dong and Jian, Like and Ma, Jianfeng and Situ, Jingyi and Bai, Lin},
title = {Asynchronous Multi-Agent Reinforcement Learning Aided Packet-Routing for Space-Air-Ground Integrated Networks},
journal = {IEEE Transactions on Mobile Computing},
year = {2026},
volume = {25},
number = {12},
pages = {23418--23434},
doi = {10.1109/tmc.2026.3727501}
}
EUVIMED