EUVIMEDEUVIMED entdecken
Crossref

InParformer: Evolutionary Decomposition Transformers with Interactive Parallel Attention for Long-Term Time Series Forecasting

Haizhou Cao, Zhenhao Huang, Tiechui Yao, Jue Wang, Hui He, Yangang Wang

Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (6) · 6906-6915

DOI: 10.1609/aaai.v37i6.25845 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Haizhou Cao und 5 weiteren Autor:innen. Die Arbeit wurde bisher 35-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Long-term time series forecasting (LTSF) provides substantial benefits for numerous real-world applications, whereas places essential demands on the model capacity to capture long-range dependencies. Recent Transformer-based models have significantly improved LTSF performance. It is worth noting that Transformer with the self-attention mechanism was originally proposed to model language sequences whose tokens (i.e., words) are discrete and highly semantic. However, unlike language sequences, most time series are sequential and continuous numeric points. Time steps with temporal redundancy are weakly semantic, and only leveraging time-domain tokens is hard to depict the overall properties of time series (e.g., the overall trend and periodic variations). To address these problems, we propose a novel Transformer-based forecasting model named InParformer with an Interactive Parallel Attention (InPar Attention) mechanism. The InPar Attention is proposed to learn long-range dependencies comprehensively in both frequency and time domains. To improve its learning capacity and efficiency, we further design several mechanisms, including query selection, key-value pair compression, and recombination. Moreover, InParformer is constructed with evolutionary seasonal-trend decomposition modules to enhance intricate temporal pattern extraction. Extensive experiments on six real-world benchmarks show that InParformer outperforms the state-of-the-art forecasting Transformers.

Zitieren

APA

Cao, H., Huang, Z., Yao, T., Wang, J., He, H., & Wang, Y. (2023). InParformer: Evolutionary Decomposition Transformers with Interactive Parallel Attention for Long-Term Time Series Forecasting. Proceedings of the AAAI Conference on Artificial Intelligence, 37(6), 6906-6915. https://doi.org/10.1609/aaai.v37i6.25845

Vancouver

Cao H, Huang Z, Yao T, Wang J, He H, Wang Y. InParformer: Evolutionary Decomposition Transformers with Interactive Parallel Attention for Long-Term Time Series Forecasting. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(6):6906-6915. doi:10.1609/aaai.v37i6.25845

BibTeX
@article{Cao2023,
  author = {Cao, Haizhou and Huang, Zhenhao and Yao, Tiechui and Wang, Jue and He, Hui and Wang, Yangang},
  title = {InParformer: Evolutionary Decomposition Transformers with Interactive Parallel Attention for Long-Term Time Series Forecasting},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2023},
  volume = {37},
  number = {6},
  pages = {6906--6915},
  doi = {10.1609/aaai.v37i6.25845}
}
Kostenlos starten →