Bi-Timescale Hierarchical Safe Reinforcement Learning for Coordinated Virtual Inertia and Damping Control in Grid-Forming Converters
IEEE Access · 2026 · 14 · 110759-110775
DOI: 10.1109/access.2026.3714878 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Zhilin Dong und 7 weiteren Autor:innen. Die Arbeit nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: China Electric Power Planning and Engineering Institute (EPPEI) Smart Energy Company Ltd., “Research on Key Technologies of Cascaded Direct-Connected Grid-Forming Static Var Generator (SVG)”, Beijing Municipal Science and Technology Commission, Science and Technology Service Industry Special Project.
Abstract (Originalsprache)
The increasing penetration of inverter-based renewable generation has reduced system inertia and posed new challenges to frequency stability in modern power systems. Virtual synchronous generator (VSG) control can provide virtual inertia and damping support, but its performance strongly depends on the proper coordination of these parameters under varying operating conditions. Existing adaptive and reinforcement-learning-based methods usually regulate virtual inertia and damping at the same timescale, which may ignore their distinct physical roles and lead to coupled parameter variations. To address this issue, this paper proposes a bi-timescale hierarchical safe reinforcement learning framework, termed BiTS-HSRL-JD, for coordinated virtual inertia and damping control in grid-forming converters. In the proposed framework, a slow-timescale policy schedules virtual inertia according to operating conditions, while a fast-timescale policy adjusts the damping coefficient to suppress transient oscillations. A stage-aware state representation and a safety projection layer are further introduced to improve transient adaptability and enforce practical constraints on parameter bounds and variation rates. The proposed method is validated using a MATLAB/Simulink-based VSG system under strong-grid and weak-grid conditions, power-step disturbances, and load-switching events. Comparative results show that BiTS-HSRL-JD reduces RoCoF, improves frequency recovery, and suppresses oscillations more effectively than fixed-parameter, rule-based adaptive, and single-policy reinforcement learning methods.
Förderung
- China Electric Power Planning and Engineering Institute (EPPEI) Smart Energy Company Ltd.
- “Research on Key Technologies of Cascaded Direct-Connected Grid-Forming Static Var Generator (SVG)”
- Beijing Municipal Science and Technology Commission, Science and Technology Service Industry Special Project
Zitieren
APA
Dong, Z., Xiong, H., Su, R., Yang, J., Zhang, S., Shen, Q., Chang, Y., & Zhang, M. (2026). Bi-Timescale Hierarchical Safe Reinforcement Learning for Coordinated Virtual Inertia and Damping Control in Grid-Forming Converters. IEEE Access, 14, 110759-110775. https://doi.org/10.1109/access.2026.3714878
Vancouver
Dong Z, Xiong H, Su R, Yang J, Zhang S, Shen Q, et al. Bi-Timescale Hierarchical Safe Reinforcement Learning for Coordinated Virtual Inertia and Damping Control in Grid-Forming Converters. IEEE Access. 2026;14:110759-110775. doi:10.1109/access.2026.3714878
BibTeX
@article{Dong2026,
author = {Dong, Zhilin and Xiong, Haoqing and Su, Rongqiang and Yang, Jun and Zhang, Shaohua and Shen, Qianfeng and Chang, Yixin and Zhang, Meng},
title = {Bi-Timescale Hierarchical Safe Reinforcement Learning for Coordinated Virtual Inertia and Damping Control in Grid-Forming Converters},
journal = {IEEE Access},
year = {2026},
volume = {14},
pages = {110759--110775},
doi = {10.1109/access.2026.3714878}
}
EUVIMED