EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep Q-Learning-Based Smart Scheduling of EVs for Demand Response in Smart Grids

Viorica Rozina Chifu, Tudor Cioara, Cristina Bianca Pop, Horia Gabriel Rusu, Ionut Anghel

Applied Sciences · 08.02.2024 · 14 (4) · 1421

DOI: 10.3390/app14041421 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 08.02.2024. Verfasst von Viorica Rozina Chifu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union’s Horizon Europe research and innovation program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Economic and policy factors are driving the continuous increase in the adoption and usage of electrical vehicles (EVs). However, despite being a cleaner alternative to combustion engine vehicles, EVs have negative impacts on the lifespan of microgrid equipment and energy balance due to increased power demands and the timing of their usage. In our view, grid management should leverage on EV scheduling flexibility to support local network balancing through active participation in demand response programs. In this paper, we propose a model-free solution, leveraging deep Q-learning to schedule the charging and discharging activities of EVs within a microgrid to align with a target energy profile provided by the distribution system operator. We adapted the Bellman equation to assess the value of a state based on specific rewards for EV scheduling actions and used a neural network to estimate Q-values for available actions and the epsilon-greedy algorithm to balance exploitation and exploration to meet the target energy profile. The results are promising, showing the effectiveness of the proposed solution in scheduling the charging and discharging actions for a fleet of 30 EVs to align with the target energy profile in demand response programs, achieving a Pearson coefficient of 0.99. This solution also demonstrates a high degree of adaptability in effectively managing scheduling situations for EVs that involve dynamicity, influenced by various state-of-charge distributions and e-mobility features. Adaptability is achieved solely through learning from data without requiring prior knowledge, configurations, or fine-tuning.

Förderung

  • European Union’s Horizon Europe research and innovation program

Zitieren

APA

Chifu, V. R., Cioara, T., Pop, C. B., Rusu, H. G., & Anghel, I. (2024). Deep Q-Learning-Based Smart Scheduling of EVs for Demand Response in Smart Grids. Applied Sciences, 14(4), 1421. https://doi.org/10.3390/app14041421

Vancouver

Chifu VR, Cioara T, Pop CB, Rusu HG, Anghel I. Deep Q-Learning-Based Smart Scheduling of EVs for Demand Response in Smart Grids. Applied Sciences. 2024;14(4):1421. doi:10.3390/app14041421

BibTeX
@article{Chifu2024,
  author = {Chifu, Viorica Rozina and Cioara, Tudor and Pop, Cristina Bianca and Rusu, Horia Gabriel and Anghel, Ionut},
  title = {Deep Q-Learning-Based Smart Scheduling of EVs for Demand Response in Smart Grids},
  journal = {Applied Sciences},
  year = {2024},
  volume = {14},
  number = {4},
  pages = {1421},
  doi = {10.3390/app14041421}
}
Kostenlos starten →