EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Nested Multi-Agent Reinforcement Learning for Adaptive Resource Management in 6G Network Slicing: A Multi-Timescale Framework With Convergence Guarantees

Abraheem Rashid, Faisal Iradat, Waseem Iqbal, Ikram Syed, Khalil Khan, Khalid Yahya

IEEE Open Journal of the Communications Society · 2026 · 7 · 7624-7640

DOI: 10.1109/ojcoms.2026.3708409 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Open Journal of the Communications Society, 2026. Verfasst von Abraheem Rashid und 5 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deanship of Research, Sultan Qaboos Unversity.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sixth-generation (6G) networks are expected to rely on agentic artificial intelligence for zero-touch, self-managed orchestration of heterogeneous network slices serving enhanced mobile broadband (eMBB), ultra-reliable low-latency communication (URLLC), and massive machine-type communication (mMTC). A central and under-studied challenge for adaptive multi-agent resource management (AMRM) in such settings is multi-timescale non-stationarity: channel fading evolves per time-slot, user demand shifts at the window scale, and service-level agreement (SLA) regimes change at an operational scale. Single-timescale multi-agent reinforcement learning (MARL) algorithms cannot track all three signals cleanly—a learning rate fast enough for the per-slot channel destabilises the coordination structure that governs longer-timescale policies. This paper proposes Nested-MARL, an independent-learner actor-critic algorithm in which each agent’s parameters are partitioned into three groups updated at separated rates $\alpha _{0}\!\ll \!\alpha _{1}\!\ll \!\alpha _{2}$ , with a continuum-memory exponential moving average (EMA) anchoring the slowest group. The design is grounded in the Nested Learning paradigm of Behrouz et al. (2025) and is extended here from single-model continual learning to decentralised multi-agent coordination. We establish a finite-time convergence result in the two-timescale stochastic approximation framework showing that under standard regularity and timescale-separation conditions, Nested-MARL achieves $O(T^{-1/2})$ fast-group convergence vs. an $\Omega (T^{-1/3})$ lower bound for any single-timescale algorithm. An empirical study on a three-agent 6G slicing simulator with continuous multi-timescale drift shows Nested-MARL outperforms independent PPO (IPPO) in mean reward at every drift severity we test ( $\kappa \!\in \!\{0.5,1.0,1.5,2.0\}$ ) and by + 8.6% in sample efficiency over the first 40 episodes at $\kappa {=}1.5$ ( $n{=}10$ seeds, $p\lt 0.05$ ). A controlled ablation establishes that stripping timescale separation reduces performance below the IPPO baseline, isolating timescale separation as the causal mechanism. Nested-MARL also reduces policy switching cost by 16.6%, an operationally meaningful benefit for zero-touch orchestration. The complete simulator, agents, and 60 + per-seed training runs are released as open source.

Förderung

  • Deanship of Research, Sultan Qaboos Unversity

Zitieren

APA

Rashid, A., Iradat, F., Iqbal, W., Syed, I., Khan, K., & Yahya, K. (2026). Nested Multi-Agent Reinforcement Learning for Adaptive Resource Management in 6G Network Slicing: A Multi-Timescale Framework With Convergence Guarantees. IEEE Open Journal of the Communications Society, 7, 7624-7640. https://doi.org/10.1109/ojcoms.2026.3708409

Vancouver

Rashid A, Iradat F, Iqbal W, Syed I, Khan K, Yahya K. Nested Multi-Agent Reinforcement Learning for Adaptive Resource Management in 6G Network Slicing: A Multi-Timescale Framework With Convergence Guarantees. IEEE Open Journal of the Communications Society. 2026;7:7624-7640. doi:10.1109/ojcoms.2026.3708409

BibTeX
@article{Rashid2026,
  author = {Rashid, Abraheem and Iradat, Faisal and Iqbal, Waseem and Syed, Ikram and Khan, Khalil and Yahya, Khalid},
  title = {Nested Multi-Agent Reinforcement Learning for Adaptive Resource Management in 6G Network Slicing: A Multi-Timescale Framework With Convergence Guarantees},
  journal = {IEEE Open Journal of the Communications Society},
  year = {2026},
  volume = {7},
  pages = {7624--7640},
  doi = {10.1109/ojcoms.2026.3708409}
}
Kostenlos starten →