Transformer with Adaptive Sparse Self-Attention for Short-Term Photovoltaic Power Generation Forecasting
Electronics · 11.10.2025 · 14 (20) · 3981
DOI: 10.3390/electronics14203981 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 11.10.2025. Verfasst von Xingfa Zi und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Yunnan Fundamental Research Projects, the Special Basic Cooperative Research Programs of Yunnan Provincial Undergraduate Universities’ Association, Yunnan Provincial Department of Education Science Research Fund Project.
Abstract (Originalsprache)
Accurate short-term photovoltaic (PV) power generation forecasting is critical for the stable integration of renewable energy into the grid. This study proposes a Transformer model enhanced with an adaptive sparse self-attention (ASSA) mechanism for PV power forecasting. The ASSA framework employs a dual-branch attention structure that combines sparse and dense attention paths with adaptive weighting to effectively filter noise while preserving essential spatiotemporal features. This design addresses the critical issues of computational redundancy and noise amplification in standard self-attention by adaptively filtering irrelevant interactions while maintaining global dependencies in Transformer-based PV forecasting. In addition, a deep feedforward network and a feature refinement feedforward network (FRFN) adapted from the ASSA–Transformer are incorporated to further improve feature extraction. The proposed algorithms are evaluated using time-series data from the Desert Knowledge Australia Solar Centre (DKASC), with input features including temperature, relative humidity, and other environmental variables. Comprehensive experiments demonstrate that the ASSA models’ accuracy in short-term PV power forecasting increases with longer forecast horizons. For 1 h ahead forecasts, it achieves an R2 of 0.9115, outperforming all other models. Under challenging rainfall conditions, the model maintains a high prediction accuracy, with an R2 of 0.7463, a mean absolute error of 0.4416, and a root mean square error of 0.6767, surpassing all compared models. The ASSA attention mechanism enhances the accuracy and stability in short-term PV power forecasting with minimal computational overhead, increasing the training time by only 1.2% compared to that for the standard Transformer.
Förderung
- Yunnan Fundamental Research Projects
- the Special Basic Cooperative Research Programs of Yunnan Provincial Undergraduate Universities’ Association
- Yunnan Provincial Department of Education Science Research Fund Project
- 2025 Self-funded Science and Technology Projects of Chuxiong Prefecture
- Chuxiong Normal University Doctoral Research Initiation Fund Project
- Dongying Science Development Fund
Zitieren
APA
Zi, X., Liu, F., Liu, M., & Wang, Y. (2025). Transformer with Adaptive Sparse Self-Attention for Short-Term Photovoltaic Power Generation Forecasting. Electronics, 14(20), 3981. https://doi.org/10.3390/electronics14203981
Vancouver
Zi X, Liu F, Liu M, Wang Y. Transformer with Adaptive Sparse Self-Attention for Short-Term Photovoltaic Power Generation Forecasting. Electronics. 2025;14(20):3981. doi:10.3390/electronics14203981
BibTeX
@article{Zi2025,
author = {Zi, Xingfa and Liu, Feiyi and Liu, Mingyang and Wang, Yang},
title = {Transformer with Adaptive Sparse Self-Attention for Short-Term Photovoltaic Power Generation Forecasting},
journal = {Electronics},
year = {2025},
volume = {14},
number = {20},
pages = {3981},
doi = {10.3390/electronics14203981}
}
EUVIMED