Operation Optimization of Direct Renewable-to-Load System Using Deep Reinforcement Learning
Energies · 01.07.2026 · 19 (13) · 3133
DOI: 10.3390/en19133133 ↗Kurz gefasst
Fachartikel in der Zeitschrift Energies, online erschienen am 01.07.2026. Verfasst von Ao Wang und 1 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key R&D Program of China.
Abstract (Originalsprache)
Direct renewable-to-load systems have emerged as a promising pathway for improving local renewable energy utilization for large electricity consumers under constrained grid interaction and device operating limits. This paper investigates a park-level direct renewable-to-load system integrating battery energy storage and power-to-hydrogen facilities and formulates its operation problem as a sequential continuous-control task. A Deep Deterministic Policy Gradient (DDPG)-based scheduling framework is developed to explicitly model renewable generation, load demand, battery dynamics, hydrogen conversion and inventory evolution, renewable curtailment, storage-related operating cost, and the no-power-export operating boundary. Case studies based on measured wind/PV and load time-series data demonstrate that coordinated heterogeneous storage can effectively enhance system flexibility. Compared with single-type storage configurations, the coordinated battery–hydrogen scheme achieved the best overall storage performance, reducing the daily operating cost to CNY 25.28×104/day while increasing renewable energy utilization to 54.79%. Further benchmarking against MILP, GA, and a without-storage baseline shows that, although MILP remains the best offline benchmark, the proposed DDPG method provides a favorable trade-off between solution quality and online efficiency. Specifically, DDPG achieved an operating cost of CNY 20.93×104/day and a renewable energy utilization of 514.38 MWh, while requiring only 0.25 s/step for online inference. Typical-day analysis further reveals a clear functional complementarity between the two storage types; battery storage mainly provides fast short-term regulation, whereas the hydrogen subsystem mainly supports longer-duration energy shifting. These results indicate that the proposed framework offers a practical and efficient solution for the operation optimization of direct renewable-to-load systems under no-power-export constraints.
Förderung
- National Key R&D Program of China
Zitieren
APA
Wang, A., & Geng, G. (2026). Operation Optimization of Direct Renewable-to-Load System Using Deep Reinforcement Learning. Energies, 19(13), 3133. https://doi.org/10.3390/en19133133
Vancouver
Wang A, Geng G. Operation Optimization of Direct Renewable-to-Load System Using Deep Reinforcement Learning. Energies. 2026;19(13):3133. doi:10.3390/en19133133
BibTeX
@article{Wang2026,
author = {Wang, Ao and Geng, Guangchao},
title = {Operation Optimization of Direct Renewable-to-Load System Using Deep Reinforcement Learning},
journal = {Energies},
year = {2026},
volume = {19},
number = {13},
pages = {3133},
doi = {10.3390/en19133133}
}
EUVIMED