Deep Reinforcement Learning Based Multi-Timescale Volt/Var Control in Distribution Networks Considering Network Reconfiguration
IEEE Transactions on Sustainable Energy · 2025-10 · 16 (4) · 2948-2958
DOI: 10.1109/tste.2025.3574806 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Sustainable Energy, 2025-10. Verfasst von Hexiang Peng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 35 Literaturangaben. Gefördert von: Sichuan Science and Technology Program.
Abstract (Originalsprache)
Coordinating Volt/Var control (VVC) across multiple timescales in distribution networks is challenging due to the diverse response characteristics of control devices. This paper proposes a novel bi-level data-driven multi-timescale VVC method to achieve coordinated control. The method integrates short-timescale control of continuous devices, such as photovoltaics, with longer-timescale control of discrete devices, including capacitor banks, and network reconfiguration. The VVC problem is formulated as a bi-level partially observable Markov decision process (POMDP). Inner-level control employs the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm for continuous devices, while outer-level control uses the Deep Double Q-Network (DDQN) algorithm for discrete devices and network reconfiguration. Collaborative training is achieved by aligning reward signals and providing inner-level agent actions as state information to outer-level agents. To mitigate over-exploration caused by network reconfiguration, graph neural networks (GNNs) are utilized to identify representative topologies, simplifying the reconfiguration space. The proposed method is validated on the IEEE 33-bus and PG&E 69-bus systems, demonstrating superior VVC performance and enhanced robustness to topological variations.
Förderung
- Sichuan Science and Technology Program
Zitieren
APA
Peng, H., Liao, K., Yang, J., Pang, B., & He, Z. (2025). Deep Reinforcement Learning Based Multi-Timescale Volt/Var Control in Distribution Networks Considering Network Reconfiguration. IEEE Transactions on Sustainable Energy, 16(4), 2948-2958. https://doi.org/10.1109/tste.2025.3574806
Vancouver
Peng H, Liao K, Yang J, Pang B, He Z. Deep Reinforcement Learning Based Multi-Timescale Volt/Var Control in Distribution Networks Considering Network Reconfiguration. IEEE Transactions on Sustainable Energy. 2025;16(4):2948-2958. doi:10.1109/tste.2025.3574806
BibTeX
@article{Peng2025,
author = {Peng, Hexiang and Liao, Kai and Yang, Jianwei and Pang, Bo and He, Zhengyou},
title = {Deep Reinforcement Learning Based Multi-Timescale Volt/Var Control in Distribution Networks Considering Network Reconfiguration},
journal = {IEEE Transactions on Sustainable Energy},
year = {2025},
volume = {16},
number = {4},
pages = {2948--2958},
doi = {10.1109/tste.2025.3574806}
}
EUVIMED