Optimising Time Series Forecasting Transformers to Linear Complexity
Energy Internet · 2025-12 · 2 (4) · 275-286
DOI: 10.1049/ein2.70016 ↗Kurz gefasst
Fachartikel in der Zeitschrift Energy Internet, online erschienen am 14.12.2025. Verfasst von Yichuan Cheng und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Accurate time series forecasting is a cornerstone of contemporary power and energy systems, supporting essential operational and planning functions including short‐term load prediction, electricity price forecasting and so on. Transformer‐based models achieve state‐of‐the‐art results by embedding series into tokens, but their quadratic time and space complexity limits the practical applications in real‐world scenarios. In this paper, we propose to chunk the tokens before feeding them to the encoder, in which attention calculations between tokens are limited to within the same chunk. Leveraging the frequency domain characteristics of the series, we employ locality sensitive hashing (LSH) techniques to ensure that series with similar frequency patterns are assigned to the same chunk. By fixing the chunk size, our method reduces the complexity of the transformer‐based model from to . Within each chunk, distilled features are concatenated to incorporate global information. Additionally, the running score update mechanism allows our framework to adapt the chunking strategy according to the data distribution. Extensive experiments demonstrate that, across multiple real‐world datasets and models, the proposed method maintains performance comparable to the original models while substantially reducing computational complexity and memory usage.
Zitieren
APA
Cheng, Y., Zhang, S., & Li, H. (2025). Optimising Time Series Forecasting Transformers to Linear Complexity. Energy Internet, 2(4), 275-286. https://doi.org/10.1049/ein2.70016
Vancouver
Cheng Y, Zhang S, Li H. Optimising Time Series Forecasting Transformers to Linear Complexity. Energy Internet. 2025;2(4):275-286. doi:10.1049/ein2.70016
BibTeX
@article{Cheng2025,
author = {Cheng, Yichuan and Zhang, Shanghang and Li, Haoliang},
title = {Optimising Time Series Forecasting Transformers to Linear Complexity},
journal = {Energy Internet},
year = {2025},
volume = {2},
number = {4},
pages = {275--286},
doi = {10.1049/ein2.70016}
}
EUVIMED