EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Bi-Timescale Hierarchical Safe Reinforcement Learning for Coordinated Virtual Inertia and Damping Control in Grid-Forming Converters

Zhilin Dong, Haoqing Xiong, Rongqiang Su, Jun Yang, Shaohua Zhang, Qianfeng Shen, Yixin Chang, Meng Zhang

IEEE Access · 2026 · 14 · 110759-110775

DOI: 10.1109/access.2026.3714878 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Zhilin Dong und 7 weiteren Autor:innen. Die Arbeit nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: China Electric Power Planning and Engineering Institute (EPPEI) Smart Energy Company Ltd., “Research on Key Technologies of Cascaded Direct-Connected Grid-Forming Static Var Generator (SVG)”, Beijing Municipal Science and Technology Commission, Science and Technology Service Industry Special Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The increasing penetration of inverter-based renewable generation has reduced system inertia and posed new challenges to frequency stability in modern power systems. Virtual synchronous generator (VSG) control can provide virtual inertia and damping support, but its performance strongly depends on the proper coordination of these parameters under varying operating conditions. Existing adaptive and reinforcement-learning-based methods usually regulate virtual inertia and damping at the same timescale, which may ignore their distinct physical roles and lead to coupled parameter variations. To address this issue, this paper proposes a bi-timescale hierarchical safe reinforcement learning framework, termed BiTS-HSRL-JD, for coordinated virtual inertia and damping control in grid-forming converters. In the proposed framework, a slow-timescale policy schedules virtual inertia according to operating conditions, while a fast-timescale policy adjusts the damping coefficient to suppress transient oscillations. A stage-aware state representation and a safety projection layer are further introduced to improve transient adaptability and enforce practical constraints on parameter bounds and variation rates. The proposed method is validated using a MATLAB/Simulink-based VSG system under strong-grid and weak-grid conditions, power-step disturbances, and load-switching events. Comparative results show that BiTS-HSRL-JD reduces RoCoF, improves frequency recovery, and suppresses oscillations more effectively than fixed-parameter, rule-based adaptive, and single-policy reinforcement learning methods.

Förderung

  • China Electric Power Planning and Engineering Institute (EPPEI) Smart Energy Company Ltd.
  • “Research on Key Technologies of Cascaded Direct-Connected Grid-Forming Static Var Generator (SVG)”
  • Beijing Municipal Science and Technology Commission, Science and Technology Service Industry Special Project

Zitieren

APA

Dong, Z., Xiong, H., Su, R., Yang, J., Zhang, S., Shen, Q., Chang, Y., & Zhang, M. (2026). Bi-Timescale Hierarchical Safe Reinforcement Learning for Coordinated Virtual Inertia and Damping Control in Grid-Forming Converters. IEEE Access, 14, 110759-110775. https://doi.org/10.1109/access.2026.3714878

Vancouver

Dong Z, Xiong H, Su R, Yang J, Zhang S, Shen Q, et al. Bi-Timescale Hierarchical Safe Reinforcement Learning for Coordinated Virtual Inertia and Damping Control in Grid-Forming Converters. IEEE Access. 2026;14:110759-110775. doi:10.1109/access.2026.3714878

BibTeX
@article{Dong2026,
  author = {Dong, Zhilin and Xiong, Haoqing and Su, Rongqiang and Yang, Jun and Zhang, Shaohua and Shen, Qianfeng and Chang, Yixin and Zhang, Meng},
  title = {Bi-Timescale Hierarchical Safe Reinforcement Learning for Coordinated Virtual Inertia and Damping Control in Grid-Forming Converters},
  journal = {IEEE Access},
  year = {2026},
  volume = {14},
  pages = {110759--110775},
  doi = {10.1109/access.2026.3714878}
}
Kostenlos starten →