Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability
Sensors · 02.02.2023 · 23 (3) · 1618
DOI: 10.3390/s23031618 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 02.02.2023. Verfasst von Ding Liu und 3 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Networked Control Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China. Die Arbeit wurde bisher 72-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key R&D Program of China, National Key R&D Program of China.
Abstract (Originalsprache)
The rapid development of electric vehicle (EV) technology and the consequent charging demand have brought challenges to the stable operation of distribution networks (DNs). The problem of the collaborative optimization of the charging scheduling of EVs and voltage control of the DN is intractable because the uncertainties of both EVs and the DN need to be considered. In this paper, we propose a deep reinforcement learning (DRL) approach to coordinate EV charging scheduling and distribution network voltage control. The DRL-based strategy contains two layers, the upper layer aims to reduce the operating costs of power generation of distributed generators and power consumption of EVs, and the lower layer controls the Volt/Var devices to maintain the voltage stability of the distribution network. We model the coordinate EV charging scheduling and voltage control problem in the distribution network as a Markov decision process (MDP). The model considers uncertainties of charging process caused by the charging behavior of EV users, as well as the uncertainty of uncontrollable load, system dynamic electricity price and renewable energy generation. Since the model has a dynamic state space and mixed action outputs, a framework of deep deterministic policy gradient (DDPG) is adopted to train the two-layer agent and the policy network is designed to output discrete and continuous control actions. Simulation and numerical results on the IEEE-33 bus test system demonstrate the effectiveness of the proposed method in collaborative EV charging scheduling and distribution network voltage stabilization.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Key Laboratory of Networked Control Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China.
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110016, China.
- Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China.
- University of Chinese Academy of Sciences, Beijing 100049, China.
ORCID-Profile: Ding Liu, Chunhe Song
Förderung
- National Key R&D Program of China
- National Key R&D Program of China
Zitieren
APA
Liu, D., Zeng, P., Cui, S., & Song, C. (2023). Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability. Sensors, 23(3), 1618. https://doi.org/10.3390/s23031618
Vancouver
Liu D, Zeng P, Cui S, Song C. Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability. Sensors. 2023;23(3):1618. doi:10.3390/s23031618
BibTeX
@article{Liu2023,
author = {Liu, Ding and Zeng, Peng and Cui, Shijie and Song, Chunhe},
title = {Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability},
journal = {Sensors},
year = {2023},
volume = {23},
number = {3},
pages = {1618},
doi = {10.3390/s23031618}
}
EUVIMED