EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Physics-Aware Reinforcement Learning for Flexibility Management in PV-Based Multi-Energy Microgrids Under Integrated Operational Constraints

Shimeng Dong, Weifeng Yao, Zenghui Li, Haiji Zhao, Yan Zhang, Zhongfu Tan

Energies · 16.10.2025 · 18 (20) · 5465

DOI: 10.3390/en18205465 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Energies, online erschienen am 16.10.2025. Verfasst von Shimeng Dong und 5 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science and Technology Project of State Grid Corporation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The growing penetration of photovoltaic (PV) generation in multi-energy microgrids has amplified the challenges of maintaining real-time operational efficiency, reliability, and safety under conditions of renewable variability and forecast uncertainty. Conventional rule-based or optimization-based strategies often suffer from limited adaptability, while purely data-driven reinforcement learning approaches risk violating physical feasibility constraints, leading to unsafe or economically inefficient operation. To address this challenge, this paper develops a Physics-Informed Reinforcement Learning (PIRL) framework that embeds first-order physical models and a structured feasibility projection mechanism directly into the training process of a Soft Actor–Critic (SAC) algorithm. Unlike traditional deep reinforcement learning, which explores the state–action space without physical safeguards, PIRL restricts learning trajectories to a physically admissible manifold, thereby preventing battery over-discharge, thermal discomfort, and infeasible hydrogen operation. Furthermore, differentiable penalty functions are employed to capture equipment degradation, user comfort, and cross-domain coupling, ensuring that the learned policy remains interpretable, safe, and aligned with engineering practice. The proposed approach is validated on a modified IEEE 33-bus distribution system coupled with 14 thermal zones and hydrogen facilities, representing a realistic and complex multi-energy microgrid environment. Simulation results demonstrate that PIRL reduces constraint violations by 75–90% and lowers operating costs by 25–30% compared with rule-based and DRL baselines while also achieving faster convergence and higher sample efficiency. Importantly, the trained policy generalizes effectively to out-of-distribution weather conditions without requiring retraining, highlighting the value of incorporating physical inductive biases for resilient control. Overall, this work establishes a transparent and reproducible reinforcement learning paradigm that bridges the gap between physical feasibility and data-driven adaptability, providing a scalable solution for safe, efficient, and cost-effective operation of renewable-rich multi-energy microgrids.

Förderung

  • Science and Technology Project of State Grid Corporation of China

Zitieren

APA

Dong, S., Yao, W., Li, Z., Zhao, H., Zhang, Y., & Tan, Z. (2025). Physics-Aware Reinforcement Learning for Flexibility Management in PV-Based Multi-Energy Microgrids Under Integrated Operational Constraints. Energies, 18(20), 5465. https://doi.org/10.3390/en18205465

Vancouver

Dong S, Yao W, Li Z, Zhao H, Zhang Y, Tan Z. Physics-Aware Reinforcement Learning for Flexibility Management in PV-Based Multi-Energy Microgrids Under Integrated Operational Constraints. Energies. 2025;18(20):5465. doi:10.3390/en18205465

BibTeX
@article{Dong2025,
  author = {Dong, Shimeng and Yao, Weifeng and Li, Zenghui and Zhao, Haiji and Zhang, Yan and Tan, Zhongfu},
  title = {Physics-Aware Reinforcement Learning for Flexibility Management in PV-Based Multi-Energy Microgrids Under Integrated Operational Constraints},
  journal = {Energies},
  year = {2025},
  volume = {18},
  number = {20},
  pages = {5465},
  doi = {10.3390/en18205465}
}
Kostenlos starten →