EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Analyzing Symbolic Properties for DRL Agents in Systems and Networking

Mohammad Zangooei, Jannis Weil, Amr Rizk, Mina Tahmasbi Arashloo, Raouf Boutaba

ACM SIGMETRICS Performance Evaluation Review · 20.07.2026 · 54 (1) · 40-42

DOI: 10.1145/3820171.3806889 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM SIGMETRICS Performance Evaluation Review, online erschienen am 27.07.2026. Verfasst von Mohammad Zangooei und 4 weiteren Autor:innen. Die Arbeit nennt 10 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Canada Research Chair grant, NSERC Discovery grant, Rogers Communications Chair in Network Automation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep reinforcement learning (DRL) has shown remarkable performance on complex control problems in systems and networking, including adaptive video streaming, wireless resource management, and congestion control. For safe deployment, however, it is critical to reason about how agents behave across the range of system states they may encounter in practice. Existing verification-based approaches in this domain primarily focus on point properties -- properties defined around fixed input states -- which offer limited coverage and require substantial manual effort to identify relevant input-output pairs for analysis. In this paper, we study symbolic properties -- properties that specify expected behaviors over ranges of input states -- for DRL agents in systems and networking. We present a generic formulation for symbolic properties, with monotonicity and robustness as concrete examples, and show how they can be analyzed using existing Deep Neural Network (DNN) verification engines. Our approach encodes symbolic properties as comparisons between related executions of the same agent and decomposes them into practically tractable sub-properties. These techniques serve as practical enablers for applying existing verification tools to symbolic properties. Using our framework, diffRL, we conduct an extensive empirical study across three representative DRL-based control systems -- adaptive video streaming, wireless resource allocation, and congestion control -- covering both discrete and continuous action spaces. Through these case studies, we analyze symbolic properties over broad input ranges, examine how property satisfaction evolves during training, study the impact of model size on verifiability, and compare multiple verification backends. Our results show that symbolic properties provide substantially broader coverage than point properties and can uncover non-obvious, operationally meaningful counterexamples, while also revealing practical solver trade-offs and limitations. Further details and comprehensive experimental results are provided in the full paper [10].

Förderung

  • Canada Research Chair grant
  • NSERC Discovery grant
  • Rogers Communications Chair in Network Automation
  • Canada Research Chair in Network Intelligence
  • NSERC Alliance
  • Mitacs
  • Ontario Research Fund – Research Excellence program
  • European Union’s Horizon Europe research and innovation programme under the ENVELOPE project

Zitieren

APA

Zangooei, M., Weil, J., Rizk, A., Arashloo, M. T., & Boutaba, R. (2026). Analyzing Symbolic Properties for DRL Agents in Systems and Networking. ACM SIGMETRICS Performance Evaluation Review, 54(1), 40-42. https://doi.org/10.1145/3820171.3806889

Vancouver

Zangooei M, Weil J, Rizk A, Arashloo MT, Boutaba R. Analyzing Symbolic Properties for DRL Agents in Systems and Networking. ACM SIGMETRICS Performance Evaluation Review. 2026;54(1):40-42. doi:10.1145/3820171.3806889

BibTeX
@article{Zangooei2026,
  author = {Zangooei, Mohammad and Weil, Jannis and Rizk, Amr and Arashloo, Mina Tahmasbi and Boutaba, Raouf},
  title = {Analyzing Symbolic Properties for DRL Agents in Systems and Networking},
  journal = {ACM SIGMETRICS Performance Evaluation Review},
  year = {2026},
  volume = {54},
  number = {1},
  pages = {40--42},
  doi = {10.1145/3820171.3806889}
}
Kostenlos starten →