A Reinforcement Learning Engine With Reduced Action and State Space for Scalable Cyber‐Physical Optimal Response
IET Cyber-Physical Systems: Theory & Applications · 2026-01 · 11 (1)
DOI: 10.1049/cps2.70051 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Cyber-Physical Systems: Theory & Applications, online erschienen am 30.04.2026. Verfasst von Shining Sun und 6 weiteren Autor:innen. Die Arbeit nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Science Foundation, U.S. Department of Energy.
Abstract (Originalsprache)
Numerous research studies have been conducted to enhance the resilience of cyber‐physical systems (CPSs) by detecting potential cyber or physical disturbances. However, the development of scalable and optimal response measures under power system contingencies based on fusing cyber‐physical data is still in an early stage. To address this research gap, this paper introduces a power system response engine based on reinforcement learning (RL) and role and interaction discovery (RID) techniques. RL‐RID‐GridResponder is designed to automatically detect the contingency and assist with the decision‐making process to ensure optimal power system operation. The RL‐RID‐GridResponder learns via an RL‐based structure and achieves enhanced scalability by integrating an RID module with reduced action and state spaces. The applicability of RL‐RID‐GridResponder in providing scalable and optimal responses for CPSs is demonstrated on power systems during cyber disturbances. Moreover, simulations are conducted on a Volt‐Var regulation problem using the augmented WSCC 9‐bus, augmented IEEE 24‐bus and IEEE 8500‐node systems based on fused cyber and physical datasets. The results show that the proposed RL‐RID‐GridResponder can provide fast and accurate responses to ensure optimal power system operation under cyber intrusions, such as DoS, and can extend to other system contingencies, such as line outages and load losses.
Förderung
- National Science Foundation
- U.S. Department of Energy
Zitieren
APA
Sun, S., Haque, K. A., Huo, X., Homoud, L. A., Hossain‐McKenzie, S., Goulart, A., & Davis, K. (2026). A Reinforcement Learning Engine With Reduced Action and State Space for Scalable Cyber‐Physical Optimal Response. IET Cyber-Physical Systems: Theory & Applications, 11(1). https://doi.org/10.1049/cps2.70051
Vancouver
Sun S, Haque KA, Huo X, Homoud LA, Hossain‐McKenzie S, Goulart A, et al. A Reinforcement Learning Engine With Reduced Action and State Space for Scalable Cyber‐Physical Optimal Response. IET Cyber-Physical Systems: Theory & Applications. 2026;11(1). doi:10.1049/cps2.70051
BibTeX
@article{Sun2026,
author = {Sun, Shining and Haque, Khandaker Akramul and Huo, Xiang and Homoud, Leen Al and Hossain‐McKenzie, Shamina and Goulart, Ana and Davis, Katherine},
title = {A Reinforcement Learning Engine With Reduced Action and State Space for Scalable Cyber‐Physical Optimal Response},
journal = {IET Cyber-Physical Systems: Theory & Applications},
year = {2026},
volume = {11},
number = {1},
doi = {10.1049/cps2.70051}
}
EUVIMED