Collaborative Hierarchical Multi-Agent Learning for RIS-Assisted Multi-Cell Integrated Sensing and Communication
Sensors · 30.10.2026 · 26 (21) · 6887
DOI: 10.3390/s26216887 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 30.10.2026. Verfasst von Ammar Summaq und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electronics and Communication Engineering, School of Engineering and Science, SRM University-AP, Amaravathi 522240, Andhra Pradesh, Ind…. Die Arbeit nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: SRM University, Andhra Pradesh, SRM University-AP Seed Fund, India.
Abstract (Originalsprache)
The convergence of integrated sensing and communication (ISAC) and reconfigurable intelligent surfaces (RISs) offers new opportunities for building adaptive and energy-efficient 6G wireless networks. By jointly exploiting sensing information and programmable wireless propagation, these technologies can support intelligent network operation in highly dynamic environments. However, realizing these benefits in multi-user and multi-cell networks requires jointly controlling several strongly interconnected variables, including transmit beamforming, RIS configurations, power allocation, and user association. This problem becomes increasingly difficult in the presence of user mobility, imperfect channel state information (CSI), and strong interference among neighboring cells. Existing iterative optimization algorithms can become computationally demanding for large-scale networks, whereas conventional flat multi-agent reinforcement learning (MARL) approaches often struggle with the rapidly growing action space and limited inter-agent coordination. To address these limitations, this study develops an HDRL-ISAC framework based on hierarchical multi-agent learning and centralized training with decentralized execution (CTDE). The proposed framework assigns different decision-making roles across the hierarchy, allowing high-level agents to coordinate network-wide cellular decisions while lower-level agents perform user-specific resource optimization. This hierarchical decomposition improves the learning efficiency and enables scalable coordination in multi-cell environments. Furthermore, sensing information is incorporated into the learning process through EKF-based mobility prediction, enabling agents to anticipate user movement and adapt their resource allocation decisions accordingly. Lightweight information exchange among neighboring cells is also introduced to facilitate interference-aware coordination under imperfect CSI. Simulation results demonstrate that the proposed HDRL-ISAC approach improves energy efficiency by up to 35%, reduces inter-cell interference leakage by up to 6 dB, and decreases ping-pong handovers by up to 40% compared to benchmark schemes. Crucially, the proposed architecture achieves approximately 1.8× faster training convergence than conventional flat MARL approaches while avoiding the prohibitive online computational delays associated with conventional iterative optimization methods. These findings indicate that hierarchical and sensing-aware multi-agent learning provides a promising approach for scalable resource management in future RIS-assisted multi-cell ISAC networks.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electronics and Communication Engineering, School of Engineering and Science, SRM University-AP, Amaravathi 522240, Andhra Pradesh, India.
- Department of Electronics and Communication Engineering, IIT Bhilai, Bhilai 491002, Chhattisgarh, India.
- Department of Communication Engineering, School of Electronics and Engineering, Vellore Institute of Technology, Vellore 632014, Tamil Nadu, India.
ORCID-Profile: Ammar Summaq, Mukkara Prasanna Kumar, Poongundran Selvaprabhu
Förderung
- SRM University, Andhra Pradesh
- SRM University-AP Seed Fund, India
Zitieren
APA
Summaq, A., Kumar, M. P., Elumalai, K., Selvaprabhu, P., & Chinnadurai, S. (2026). Collaborative Hierarchical Multi-Agent Learning for RIS-Assisted Multi-Cell Integrated Sensing and Communication. Sensors, 26(21), 6887. https://doi.org/10.3390/s26216887
Vancouver
Summaq A, Kumar MP, Elumalai K, Selvaprabhu P, Chinnadurai S. Collaborative Hierarchical Multi-Agent Learning for RIS-Assisted Multi-Cell Integrated Sensing and Communication. Sensors. 2026;26(21):6887. doi:10.3390/s26216887
BibTeX
@article{Summaq2026,
author = {Summaq, Ammar and Kumar, Mukkara Prasanna and Elumalai, Karthikeyan and Selvaprabhu, Poongundran and Chinnadurai, Sunil},
title = {Collaborative Hierarchical Multi-Agent Learning for RIS-Assisted Multi-Cell Integrated Sensing and Communication},
journal = {Sensors},
year = {2026},
volume = {26},
number = {21},
pages = {6887},
doi = {10.3390/s26216887}
}
EUVIMED