EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability

Ding Liu iD, Peng Zeng, Shijie Cui, Chunhe Song iD

Sensors · 02.02.2023 · 23 (3) · 1618

DOI: 10.3390/s23031618 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 02.02.2023. Verfasst von Ding Liu und 3 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Networked Control Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China. Die Arbeit wurde bisher 72-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key R&D Program of China, National Key R&D Program of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid development of electric vehicle (EV) technology and the consequent charging demand have brought challenges to the stable operation of distribution networks (DNs). The problem of the collaborative optimization of the charging scheduling of EVs and voltage control of the DN is intractable because the uncertainties of both EVs and the DN need to be considered. In this paper, we propose a deep reinforcement learning (DRL) approach to coordinate EV charging scheduling and distribution network voltage control. The DRL-based strategy contains two layers, the upper layer aims to reduce the operating costs of power generation of distributed generators and power consumption of EVs, and the lower layer controls the Volt/Var devices to maintain the voltage stability of the distribution network. We model the coordinate EV charging scheduling and voltage control problem in the distribution network as a Markov decision process (MDP). The model considers uncertainties of charging process caused by the charging behavior of EV users, as well as the uncertainty of uncontrollable load, system dynamic electricity price and renewable energy generation. Since the model has a dynamic state space and mixed action outputs, a framework of deep deterministic policy gradient (DDPG) is adopted to train the two-layer agent and the policy network is designed to output discrete and continuous control actions. Simulation and numerical results on the IEEE-33 bus test system demonstrate the effectiveness of the proposed method in collaborative EV charging scheduling and distribution network voltage stabilization.

Schlagwörter

Stichwörter der Autor:innen

deep reinforcement learningdistribution networkelectric vehiclevoltage control

Autor:innen und Institutionen

  • Key Laboratory of Networked Control Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China.
  • Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110016, China.
  • Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China.
  • University of Chinese Academy of Sciences, Beijing 100049, China.

ORCID-Profile: Ding Liu, Chunhe Song

Förderung

  • National Key R&D Program of China
  • National Key R&D Program of China

Zitieren

APA

Liu, D., Zeng, P., Cui, S., & Song, C. (2023). Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability. Sensors, 23(3), 1618. https://doi.org/10.3390/s23031618

Vancouver

Liu D, Zeng P, Cui S, Song C. Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability. Sensors. 2023;23(3):1618. doi:10.3390/s23031618

BibTeX
@article{Liu2023,
  author = {Liu, Ding and Zeng, Peng and Cui, Shijie and Song, Chunhe},
  title = {Deep Reinforcement Learning for Charging Scheduling of Electric Vehicles Considering Distribution Network Voltage Stability},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {3},
  pages = {1618},
  doi = {10.3390/s23031618}
}
Kostenlos starten →