Multi-Agent Deep Reinforcement Learning for Coordinated Energy Trading and Flexibility Services Provision in Local Electricity Markets
IEEE Transactions on Smart Grid · 2023-03 · 14 (2) · 1541-1554
DOI: 10.1109/tsg.2022.3149266 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Smart Grid, 2023-03. Verfasst von Yujian Ye und 4 weiteren Autor:innen. Die Arbeit wurde bisher 125-mal zitiert (Crossref) und nennt 55 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Jiangsu Province of China, 2021 Jiangsu Shuangchuang (Mass Innovation and Entrepreneurship) Talent Program.
Abstract (Originalsprache)
Local electricity markets (LEM) have recently attracted great interest as an effective solution to the challenging problem of distributed energy resources’ (DER) management. However, LEM designs combining the market functions of local energy trading and flexibility services (FS) provision to wider system operators have not attracted sufficient attention. In the context of addressing this research gap, this paper firstly provides a new model-based system-centric formulation for the coordination of such a LEM, which provides a theoretical optimality benchmark. Compared to previous formulations, it considers the time-coupling operating characteristics of flexible DERs, and optimizes the two market functions simultaneously. Furthermore, this paper explores for the very first time a model-free prosumer-centric coordination approach for such a LEM, in order to address the practical limitations of model-based system-centric approaches. This is achieved through a new multi-agent deep reinforcement learning method which combines the beneficial properties of the multi-actor-attention-critic and the prioritized experience replay approaches. Case studies on a real-world, large-scale setting validate that the proposed LEM design successfully encapsulates the economic benefits of both local energy trading and FS provision functions, and demonstrate that the proposed learning method outperforms previous methods.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Jiangsu Province of China
- 2021 Jiangsu Shuangchuang (Mass Innovation and Entrepreneurship) Talent Program
Zitieren
APA
Ye, Y., Papadaskalopoulos, D., Yuan, Q., Tang, Y., & Strbac, G. (2023). Multi-Agent Deep Reinforcement Learning for Coordinated Energy Trading and Flexibility Services Provision in Local Electricity Markets. IEEE Transactions on Smart Grid, 14(2), 1541-1554. https://doi.org/10.1109/tsg.2022.3149266
Vancouver
Ye Y, Papadaskalopoulos D, Yuan Q, Tang Y, Strbac G. Multi-Agent Deep Reinforcement Learning for Coordinated Energy Trading and Flexibility Services Provision in Local Electricity Markets. IEEE Transactions on Smart Grid. 2023;14(2):1541-1554. doi:10.1109/tsg.2022.3149266
BibTeX
@article{Ye2023,
author = {Ye, Yujian and Papadaskalopoulos, Dimitrios and Yuan, Quan and Tang, Yi and Strbac, Goran},
title = {Multi-Agent Deep Reinforcement Learning for Coordinated Energy Trading and Flexibility Services Provision in Local Electricity Markets},
journal = {IEEE Transactions on Smart Grid},
year = {2023},
volume = {14},
number = {2},
pages = {1541--1554},
doi = {10.1109/tsg.2022.3149266}
}
EUVIMED