EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications

Dimitrios Vamvakas, Panagiotis Michailidis, Christos Korkas, Elias Kosmatopoulos

Energies · 12.07.2023 · 16 (14) · 5326

DOI: 10.3390/en16145326 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Energies, online erschienen am 12.07.2023. Verfasst von Dimitrios Vamvakas und 3 weiteren Autor:innen. Die Arbeit wurde bisher 87-mal zitiert (Crossref) und nennt 122 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Commission, Smart Operation of Proactive Residential Buildings (IA), CL5-2021-D4-02-02—Efficient, sustainable and inclusive energy use.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rise in electricity, gas and oil prices and the persistently high levels of carbon emissions, there is an increasing demand for effective energy management in energy systems, including electrical grids. Recent literature exhibits large potential for optimizing the behavior of such systems towards energy performance, reducing peak loads and exploiting environmentally friendly ways for energy production. However, the primary challenge relies on the optimization of such systems, which introduces significant complexities since they present quite dynamic behavior. Such cyberphysical frameworks usually integrate multiple interconnected components such as power plants, transmission lines, distribution networks and various types of energy-storage systems, while the behavior of these components is affected by various external factors such as user individual requirements, weather conditions, energy demand and market prices. Consequently, traditional optimal control approaches—such as Rule-Based Control (RBC)—prove inadequate to deal with the diverse dynamics which define the behavior of such complicated frameworks. Moreover, even sophisticated techniques—such as Model Predictive Control (MPC)—showcase model-related limitations that hinder the applicability of an optimal control scheme. To this end, AI model-free techniques such as Reinforcement Learning (RL) offer a fruitful potential for embedding efficient optimal control in cases of energy systems. Recent studies present promising results in various fields of engineering, indicating that RL frameworks may prove the key element for delivering efficient optimal control in smart buildings, electric vehicle charging and smart grid applications. The current paper provides a comprehensive review of RL implementations in energy systems frameworks—such as Renewable Energy Sources (RESs), Building Energy-Management Systems (BEMSs) and Electric Vehicle Charging Stations (EVCSs)—illustrating the benefits and the opportunities of such approaches. The work examines more than 80 highly cited papers focusing on recent RL research applications—between 2015 and 2023—and analyzes the model-free RL potential as regards the energy systems’ control optimization in the future.

Förderung

  • European Commission
  • Smart Operation of Proactive Residential Buildings (IA)
  • CL5-2021-D4-02-02—Efficient, sustainable and inclusive energy use

Zitieren

APA

Vamvakas, D., Michailidis, P., Korkas, C., & Kosmatopoulos, E. (2023). Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications. Energies, 16(14), 5326. https://doi.org/10.3390/en16145326

Vancouver

Vamvakas D, Michailidis P, Korkas C, Kosmatopoulos E. Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications. Energies. 2023;16(14):5326. doi:10.3390/en16145326

BibTeX
@article{Vamvakas2023,
  author = {Vamvakas, Dimitrios and Michailidis, Panagiotis and Korkas, Christos and Kosmatopoulos, Elias},
  title = {Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications},
  journal = {Energies},
  year = {2023},
  volume = {16},
  number = {14},
  pages = {5326},
  doi = {10.3390/en16145326}
}
Kostenlos starten →