EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Pumped Hydro Storage Bidding in Joint Energy and Frequency Regulation Markets Under Incomplete Information: A Bayesian Multi-Agent Reinforcement Learning Approach with Price Forecasting Prior

Mingfang Lu, Junbin Gao

Energies · 14.11.2026 · 19 (22) · 5490

DOI: 10.3390/en19225490 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Energies, online erschienen am 14.11.2026. Verfasst von Mingfang Lu und 1 weiteren Autor:innen. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: State Grid Corporation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

When pumped storage participates in a joint energy and frequency regulation market, competitors’ cost parameters and bidding strategies are not fully observable. The plant must also coordinate pumping and generation schedules across periods and allocate limited capacity between the two markets. The resulting high-dimensional continuous action space and strong physical constraints make bidding optimization under incomplete information sample-inefficient and difficult to converge. This paper therefore proposes a pumped storage bidding strategy that incorporates prior information from forecast electricity prices. First, a directed graph neural network price forecasting model driven by multi-scenario clustering is developed. Historical price data are clustered to decouple operating scenarios, and the directed dependencies between price and its drivers, together with multi-scale temporal features, are learned separately for each scenario to improve day-ahead price forecasting accuracy. Second, the forecast prices are converted into a pumping/generation state prior and a bidding price benchmark prior, thereby constraining the bidding action space. Finally, Bayesian multi-agent reinforcement learning is used to solve the bidding and clearing model. The case study results show that the proposed forecasting model improves the coefficient of determination (R2) from 0.787 to 0.868. Compared with bidding strategies that consider only a single prior, the proposed strategy increases the net revenue of pumped hydro storage by 18.3%.

Förderung

  • State Grid Corporation of China

Zitieren

APA

Lu, M., & Gao, J. (2026). Pumped Hydro Storage Bidding in Joint Energy and Frequency Regulation Markets Under Incomplete Information: A Bayesian Multi-Agent Reinforcement Learning Approach with Price Forecasting Prior. Energies, 19(22), 5490. https://doi.org/10.3390/en19225490

Vancouver

Lu M, Gao J. Pumped Hydro Storage Bidding in Joint Energy and Frequency Regulation Markets Under Incomplete Information: A Bayesian Multi-Agent Reinforcement Learning Approach with Price Forecasting Prior. Energies. 2026;19(22):5490. doi:10.3390/en19225490

BibTeX
@article{Lu2026,
  author = {Lu, Mingfang and Gao, Junbin},
  title = {Pumped Hydro Storage Bidding in Joint Energy and Frequency Regulation Markets Under Incomplete Information: A Bayesian Multi-Agent Reinforcement Learning Approach with Price Forecasting Prior},
  journal = {Energies},
  year = {2026},
  volume = {19},
  number = {22},
  pages = {5490},
  doi = {10.3390/en19225490}
}
Kostenlos starten →