EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Co-Optimization of Capacity and Operation for Battery-Hydrogen Hybrid Energy Storage Systems Based on Deep Reinforcement Learning and Mixed Integer Programming

Tiantian Qian, Kaifeng Zhang, Difen Shi, Lei Zhang

Energies · 27.10.2025 · 18 (21) · 5638

DOI: 10.3390/en18215638 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Energies, online erschienen am 27.10.2025. Verfasst von Tiantian Qian und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Jiangsu Provincial Science and Technology Project, Jiangsu Provincial Universities’ Basic Science Research General, Talent-Introduction Research Start-up Fund.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The hybrid energy storage system (HESS) that combines battery with hydrogen storage exploits complementary power/energy characteristics, but most studies optimize capacity and operation separately, leading to suboptimal overall performance. To address this issue, this paper proposes a bi-level co-optimization framework that integrates deep reinforcement learning (DRL) and mixed integer programming (MIP). The outer layer employs the TD3 algorithm for capacity configuration, while the inner layer uses the Gurobi solver for optimal operation under constraints. On a standalone PV–wind–load-HESS system, the method attains near-optimal quality at dramatically lower runtime. Relative to GA + Gurobi and PSO + Gurobi, the cost is lower by 4.67% and 1.31%, while requiring only 0.52% and 0.58% of their runtime; compared with a direct Gurobi solve, the cost remains comparable while runtime decreases to 0.07%. Sensitivity analysis further validates the model’s robustness under various cost parameters and renewable energy penetration levels. These results indicate that the proposed DRL–MIP cooperation achieves near-optimal solutions with orders of magnitude speedups. This study provides a new DRL–MIP paradigm for efficiently solving strongly coupled bi-level optimization problems in energy systems.

Förderung

  • Jiangsu Provincial Science and Technology Project
  • Jiangsu Provincial Universities’ Basic Science Research General
  • Talent-Introduction Research Start-up Fund

Zitieren

APA

Qian, T., Zhang, K., Shi, D., & Zhang, L. (2025). Co-Optimization of Capacity and Operation for Battery-Hydrogen Hybrid Energy Storage Systems Based on Deep Reinforcement Learning and Mixed Integer Programming. Energies, 18(21), 5638. https://doi.org/10.3390/en18215638

Vancouver

Qian T, Zhang K, Shi D, Zhang L. Co-Optimization of Capacity and Operation for Battery-Hydrogen Hybrid Energy Storage Systems Based on Deep Reinforcement Learning and Mixed Integer Programming. Energies. 2025;18(21):5638. doi:10.3390/en18215638

BibTeX
@article{Qian2025,
  author = {Qian, Tiantian and Zhang, Kaifeng and Shi, Difen and Zhang, Lei},
  title = {Co-Optimization of Capacity and Operation for Battery-Hydrogen Hybrid Energy Storage Systems Based on Deep Reinforcement Learning and Mixed Integer Programming},
  journal = {Energies},
  year = {2025},
  volume = {18},
  number = {21},
  pages = {5638},
  doi = {10.3390/en18215638}
}
Kostenlos starten →