Reinforcement learning based two‐timescale energy management for energy hub
IET Renewable Power Generation · 2024-02 · 18 (3) · 476-488
DOI: 10.1049/rpg2.12911 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Renewable Power Generation, online erschienen am 14.02.2024. Verfasst von Jinfan Chen und 8 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Maintaining energy balance and economical operation is significant for energy hub (EH) which serves as the central component. Implementing real‐time regulation for heating and cooling equipment within the EH is challenging due to their slow response time in response to the stochastic fluctuation in renewable energy sources and demands while the opposite is true for electric energy storage equipment (EST), a conventional single timescale energy management strategy is no longer sufficient to take into account the operating characteristics of all equipment. With this motivation, this study proposes a deep reinforcement learning based two‐timescale energy management strategy for EH, which controls heating & cooling equipment on a long timescale of 1 h, and EST on a short timescale of 15 min. The actions of the EST are modelled as discrete to reduce the action spaces, and the discrete‐continuous hybrid action sequential TD3 model is proposed to address the problem of handling both discrete and continuous actions in long timescale policy. A joint training approach based on the centralized training framework is proposed to learn multiple levels of policies in parallel. The case studies demonstrate that the proposed strategy reduces the economic cost and carbon emissions by 1%, and 0.5% compared to the single time‐scale strategy respectively.
Zitieren
APA
Chen, J., Mao, C., Sha, G., Sheng, W., Fan, H., Wang, D., Qiu, S., Wu, Y., & Zhang, Y. (2024). Reinforcement learning based two‐timescale energy management for energy hub. IET Renewable Power Generation, 18(3), 476-488. https://doi.org/10.1049/rpg2.12911
Vancouver
Chen J, Mao C, Sha G, Sheng W, Fan H, Wang D, et al. Reinforcement learning based two‐timescale energy management for energy hub. IET Renewable Power Generation. 2024;18(3):476-488. doi:10.1049/rpg2.12911
BibTeX
@article{Chen2024,
author = {Chen, Jinfan and Mao, Chengxiong and Sha, Guanglin and Sheng, Wanxing and Fan, Hua and Wang, Dan and Qiu, Shushan and Wu, Yunzhao and Zhang, Yao},
title = {Reinforcement learning based two‐timescale energy management for energy hub},
journal = {IET Renewable Power Generation},
year = {2024},
volume = {18},
number = {3},
pages = {476--488},
doi = {10.1049/rpg2.12911}
}
EUVIMED