Safe Deep Reinforcement Learning for Resource Allocation With Peak Age of Information Violation Guarantees
IEEE Transactions on Communications · 2025-12 · 73 (12) · 14197-14211
DOI: 10.1109/tcomm.2025.3591167 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Communications, 2025-12. Verfasst von Berire Gunes Reyhan und 1 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Scientific and Technological Research Council of Turkey 2247-A National Leaders Research.
Abstract (Originalsprache)
In Wireless Networked Control Systems (WNCSs), control and communication systems must be co-designed due to their strong interdependence. This paper presents a novel optimization theory-based safe deep reinforcement learning (DRL) framework for ultra-reliable WNCSs, ensuring constraint satisfaction while optimizing performance, for the first time in the literature. The approach minimizes power consumption under key constraints, including Peak Age of Information (PAoI) violation probability, transmit power, and schedulability in the finite blocklength regime. PAoI violation probability is uniquely derived by combining stochastic maximum allowable transfer interval (MATI) and maximum allowable packet delay (MAD) constraints in a multi-sensor network. The framework consists of two stages: optimization theory and safe DRL. The first stage derives optimality conditions to establish mathematical relationships among variables, simplifying and decomposing the problem. The second stage employs a safe DRL model where a teacher-student framework guides the DRL agent (student). The control mechanism (teacher) evaluates compliance with system constraints and suggests the nearest feasible action when needed. Extensive simulations show that the proposed framework outperforms rule-based and other optimization theory based DRL benchmarks, achieving faster convergence, higher rewards, and greater stability.
Förderung
- Scientific and Technological Research Council of Turkey 2247-A National Leaders Research
Zitieren
APA
Reyhan, B. G., & Coleri, S. (2025). Safe Deep Reinforcement Learning for Resource Allocation With Peak Age of Information Violation Guarantees. IEEE Transactions on Communications, 73(12), 14197-14211. https://doi.org/10.1109/tcomm.2025.3591167
Vancouver
Reyhan BG, Coleri S. Safe Deep Reinforcement Learning for Resource Allocation With Peak Age of Information Violation Guarantees. IEEE Transactions on Communications. 2025;73(12):14197-14211. doi:10.1109/tcomm.2025.3591167
BibTeX
@article{Reyhan2025,
author = {Reyhan, Berire Gunes and Coleri, Sinem},
title = {Safe Deep Reinforcement Learning for Resource Allocation With Peak Age of Information Violation Guarantees},
journal = {IEEE Transactions on Communications},
year = {2025},
volume = {73},
number = {12},
pages = {14197--14211},
doi = {10.1109/tcomm.2025.3591167}
}
EUVIMED