Research on Q-Table Design for Maximum Power Point Tracking-Based Reinforcement Learning in PV Systems
Energies · 27.10.2023 · 16 (21) · 7286
DOI: 10.3390/en16217286 ↗Kurz gefasst
Fachartikel in der Zeitschrift Energies, online erschienen am 27.10.2023. Verfasst von Yizhi Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: 2022 Jiangsu Carbon Peak and Neutrality Technology Innovation Special Fund (Industrial Foresight and Key Core Technology Research).
Abstract (Originalsprache)
Photovoltaic (PV) power generation is considered to be a clean energy source. Solar modules suffer from nonlinear behavior, which makes the maximum power point tracking (MPPT) technique for efficient PV systems particularly important. Conventional MPPT techniques are easy to implement but require fine tuning of their fixed step size. Unlike conventional MPPT, the MPPT based on reinforcement learning (RL-MPPT) has the potential to self-learn to tune step size, which is more adaptable to changing environments. As one of the typical RL algorithms, the Q-learning algorithm can find the optimal control strategy through the learned experiences stored in a Q-table. Thus, as the cornerstone of this algorithm, the Q-table has a significant impact on control ability. In this paper, a novel Q-table of reinforcement learning is proposed to maximize tracking efficiency with improved Q-table update technology. The proposed method discards the traditional MPPT idea and makes full use of the inherent characteristics of the Q-learning algorithm such as its fast dynamic response and simple algorithm principle. By establishing six kinds of Q-tables based on the RL-MPPT method, the optimal discretized state of a photovoltaic system is found to make full use of the energy of the photovoltaic system and reduce power loss. Therefore, under the En50530 dynamic test standard, this work compares the simulation and experimental results and their tracking efficiency using six kinds of Q-table, individually.
Förderung
- 2022 Jiangsu Carbon Peak and Neutrality Technology Innovation Special Fund (Industrial Foresight and Key Core Technology Research)
Zitieren
APA
Chen, Y., Lin, D., Xu, F., Li, X., Wang, W., & Ding, S. (2023). Research on Q-Table Design for Maximum Power Point Tracking-Based Reinforcement Learning in PV Systems. Energies, 16(21), 7286. https://doi.org/10.3390/en16217286
Vancouver
Chen Y, Lin D, Xu F, Li X, Wang W, Ding S. Research on Q-Table Design for Maximum Power Point Tracking-Based Reinforcement Learning in PV Systems. Energies. 2023;16(21):7286. doi:10.3390/en16217286
BibTeX
@article{Chen2023,
author = {Chen, Yizhi and Lin, Dingyi and Xu, Fei and Li, Xingshuo and Wang, Wei and Ding, Shuye},
title = {Research on Q-Table Design for Maximum Power Point Tracking-Based Reinforcement Learning in PV Systems},
journal = {Energies},
year = {2023},
volume = {16},
number = {21},
pages = {7286},
doi = {10.3390/en16217286}
}
EUVIMED