EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MARL-Converge: Decentralized Multi-Agent Reinforcement Learning for Failure-Aware Routing Convergence

David Clarke, Mei Huang, Jonas Eriksen

International Journal of Information and Communication Technology Trends · 29.07.2026 · 6 (2) · 28-41

DOI: 10.66525/ijictt106 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Information and Communication Technology Trends, online erschienen am 29.07.2026. Verfasst von David Clarke und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Routing failures demand rapid control-plane convergence, yet uniformly aggressive detection and flooding increases signaling load and can induce unstable parameter oscillations. This paper presents MARL-Converge, a decentralized multi-agent reinforcement learning framework in which every router selects a local conservative, balanced, or aggressive control profile from router-local and one-hop telemetry. A parameter-shared dueling Double Deep Q-Network is trained with shared experience and a global-dominant team reward, while execution remains decentralized. A failure-aware action mask prevents routers without local evidence from blindly escalating to the aggressive profile. We implement a reproducible discrete-time link-state convergence proxy with independent topology views, stochastic failure detection and link-state advertisement diffusion, shortest-path recomputation, and forwarding-loop/drop checks. Evaluation comprises 600 matched episodes on the real Abilene and held-out AARNet topologies from the Internet Topology Zoo. Relative to a static balanced profile, MARL-Converge reduces convergence steps by 19.0% and modeled packet loss by 83.6%; the 6.1% overhead reduction is directionally favorable but not significant at the 0.05 level. Relative to a local heuristic, it is 9.3% faster, uses 14.0% fewer control units, and makes 56.4% fewer profile switches. It is 7.6% slower than always-aggressive control but cuts overhead by 35.4%. These results establish a measured speed-stability-efficiency trade-off without claiming physical-router timing equivalence.

Zitieren

APA

Clarke, D., Huang, M., & Eriksen, J. (2026). MARL-Converge: Decentralized Multi-Agent Reinforcement Learning for Failure-Aware Routing Convergence. International Journal of Information and Communication Technology Trends, 6(2), 28-41. https://doi.org/10.66525/ijictt106

Vancouver

Clarke D, Huang M, Eriksen J. MARL-Converge: Decentralized Multi-Agent Reinforcement Learning for Failure-Aware Routing Convergence. International Journal of Information and Communication Technology Trends. 2026;6(2):28-41. doi:10.66525/ijictt106

BibTeX
@article{Clarke2026,
  author = {Clarke, David and Huang, Mei and Eriksen, Jonas},
  title = {MARL-Converge: Decentralized Multi-Agent Reinforcement Learning for Failure-Aware Routing Convergence},
  journal = {International Journal of Information and Communication Technology Trends},
  year = {2026},
  volume = {6},
  number = {2},
  pages = {28--41},
  doi = {10.66525/ijictt106}
}
Kostenlos starten →