EUVIMEDEUVIMED entdecken
Crossref

FISformer: Replacing Self-Attention With a Fuzzy Inference System in Transformer Models for Time Series Forecasting

Bulent Haznedar, Levent Karacan

IEEE Transactions on Fuzzy Systems · 2026-08 · 34 (8) · 2437-2450

DOI: 10.1109/tfuzz.2026.3690012 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Fuzzy Systems, 2026-08. Verfasst von Bulent Haznedar und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 43 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Transformers have achieved remarkable progress in time series forecasting, yet their reliance on deterministic dot-product attention limits their capacity to model uncertainty and nonlinear dependencies across multivariate temporal dimensions. To address this limitation, we propose a fuzzy inference system–driven Transformer (FISformer) that replaces conventional attention with a FIS interaction mechanism. In this framework, each query–key pair undergoes a fuzzy inference process for every feature dimension, where learnable membership functions and rule-based reasoning estimate tokenwise relational strengths. These FIS-derived interaction weights capture uncertainty and provide interpretable, continuous mappings between tokens. A softmax operation is applied along the token axis to normalize these weights, which are then combined with the corresponding value features through elementwise multiplication to yield the final context-enhanced token representations. This design fuses the interpretability and uncertainty modeling of fuzzy logic with the representational power of Transformers. Extensive experiments on multiple benchmark datasets demonstrate that FISformer achieves superior forecasting accuracy, noise robustness, and interpretability compared to state-of-the-art Transformer variants, establishing fuzzy inference as an effective alternative to conventional attention mechanisms.

Zitieren

APA

Haznedar, B., & Karacan, L. (2026). FISformer: Replacing Self-Attention With a Fuzzy Inference System in Transformer Models for Time Series Forecasting. IEEE Transactions on Fuzzy Systems, 34(8), 2437-2450. https://doi.org/10.1109/tfuzz.2026.3690012

Vancouver

Haznedar B, Karacan L. FISformer: Replacing Self-Attention With a Fuzzy Inference System in Transformer Models for Time Series Forecasting. IEEE Transactions on Fuzzy Systems. 2026;34(8):2437-2450. doi:10.1109/tfuzz.2026.3690012

BibTeX
@article{Haznedar2026,
  author = {Haznedar, Bulent and Karacan, Levent},
  title = {FISformer: Replacing Self-Attention With a Fuzzy Inference System in Transformer Models for Time Series Forecasting},
  journal = {IEEE Transactions on Fuzzy Systems},
  year = {2026},
  volume = {34},
  number = {8},
  pages = {2437--2450},
  doi = {10.1109/tfuzz.2026.3690012}
}
Kostenlos starten →