Pumped Hydro Storage Bidding in Joint Energy and Frequency Regulation Markets Under Incomplete Information: A Bayesian Multi-Agent Reinforcement Learning Approach with Price Forecasting Prior
Energies · 14.11.2026 · 19 (22) · 5490
DOI: 10.3390/en19225490 ↗Kurz gefasst
Fachartikel in der Zeitschrift Energies, online erschienen am 14.11.2026. Verfasst von Mingfang Lu und 1 weiteren Autor:innen. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: State Grid Corporation of China.
Abstract (Originalsprache)
When pumped storage participates in a joint energy and frequency regulation market, competitors’ cost parameters and bidding strategies are not fully observable. The plant must also coordinate pumping and generation schedules across periods and allocate limited capacity between the two markets. The resulting high-dimensional continuous action space and strong physical constraints make bidding optimization under incomplete information sample-inefficient and difficult to converge. This paper therefore proposes a pumped storage bidding strategy that incorporates prior information from forecast electricity prices. First, a directed graph neural network price forecasting model driven by multi-scenario clustering is developed. Historical price data are clustered to decouple operating scenarios, and the directed dependencies between price and its drivers, together with multi-scale temporal features, are learned separately for each scenario to improve day-ahead price forecasting accuracy. Second, the forecast prices are converted into a pumping/generation state prior and a bidding price benchmark prior, thereby constraining the bidding action space. Finally, Bayesian multi-agent reinforcement learning is used to solve the bidding and clearing model. The case study results show that the proposed forecasting model improves the coefficient of determination (R2) from 0.787 to 0.868. Compared with bidding strategies that consider only a single prior, the proposed strategy increases the net revenue of pumped hydro storage by 18.3%.
Förderung
- State Grid Corporation of China
Zitieren
APA
Lu, M., & Gao, J. (2026). Pumped Hydro Storage Bidding in Joint Energy and Frequency Regulation Markets Under Incomplete Information: A Bayesian Multi-Agent Reinforcement Learning Approach with Price Forecasting Prior. Energies, 19(22), 5490. https://doi.org/10.3390/en19225490
Vancouver
Lu M, Gao J. Pumped Hydro Storage Bidding in Joint Energy and Frequency Regulation Markets Under Incomplete Information: A Bayesian Multi-Agent Reinforcement Learning Approach with Price Forecasting Prior. Energies. 2026;19(22):5490. doi:10.3390/en19225490
BibTeX
@article{Lu2026,
author = {Lu, Mingfang and Gao, Junbin},
title = {Pumped Hydro Storage Bidding in Joint Energy and Frequency Regulation Markets Under Incomplete Information: A Bayesian Multi-Agent Reinforcement Learning Approach with Price Forecasting Prior},
journal = {Energies},
year = {2026},
volume = {19},
number = {22},
pages = {5490},
doi = {10.3390/en19225490}
}
EUVIMED