MARL-Converge: Decentralized Multi-Agent Reinforcement Learning for Failure-Aware Routing Convergence
International Journal of Information and Communication Technology Trends · 29.07.2026 · 6 (2) · 28-41
DOI: 10.66525/ijictt106 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Information and Communication Technology Trends, online erschienen am 29.07.2026. Verfasst von David Clarke und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Routing failures demand rapid control-plane convergence, yet uniformly aggressive detection and flooding increases signaling load and can induce unstable parameter oscillations. This paper presents MARL-Converge, a decentralized multi-agent reinforcement learning framework in which every router selects a local conservative, balanced, or aggressive control profile from router-local and one-hop telemetry. A parameter-shared dueling Double Deep Q-Network is trained with shared experience and a global-dominant team reward, while execution remains decentralized. A failure-aware action mask prevents routers without local evidence from blindly escalating to the aggressive profile. We implement a reproducible discrete-time link-state convergence proxy with independent topology views, stochastic failure detection and link-state advertisement diffusion, shortest-path recomputation, and forwarding-loop/drop checks. Evaluation comprises 600 matched episodes on the real Abilene and held-out AARNet topologies from the Internet Topology Zoo. Relative to a static balanced profile, MARL-Converge reduces convergence steps by 19.0% and modeled packet loss by 83.6%; the 6.1% overhead reduction is directionally favorable but not significant at the 0.05 level. Relative to a local heuristic, it is 9.3% faster, uses 14.0% fewer control units, and makes 56.4% fewer profile switches. It is 7.6% slower than always-aggressive control but cuts overhead by 35.4%. These results establish a measured speed-stability-efficiency trade-off without claiming physical-router timing equivalence.
Zitieren
APA
Clarke, D., Huang, M., & Eriksen, J. (2026). MARL-Converge: Decentralized Multi-Agent Reinforcement Learning for Failure-Aware Routing Convergence. International Journal of Information and Communication Technology Trends, 6(2), 28-41. https://doi.org/10.66525/ijictt106
Vancouver
Clarke D, Huang M, Eriksen J. MARL-Converge: Decentralized Multi-Agent Reinforcement Learning for Failure-Aware Routing Convergence. International Journal of Information and Communication Technology Trends. 2026;6(2):28-41. doi:10.66525/ijictt106
BibTeX
@article{Clarke2026,
author = {Clarke, David and Huang, Mei and Eriksen, Jonas},
title = {MARL-Converge: Decentralized Multi-Agent Reinforcement Learning for Failure-Aware Routing Convergence},
journal = {International Journal of Information and Communication Technology Trends},
year = {2026},
volume = {6},
number = {2},
pages = {28--41},
doi = {10.66525/ijictt106}
}
EUVIMED