EUVIMEDEUVIMED entdecken
Crossref

Spikingformer: A Key Foundation Model for Spiking Neural Networks

Chenlin Zhou, Liutao Yu, Zhaokun Zhou, Han Zhang, Jiaqi Wang, Huihui Zhou, Zhengyu Ma, Yonghong Tian

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (3) · 2236-2244

DOI: 10.1609/aaai.v40i3.37207 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Chenlin Zhou und 7 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial neural networks, due to their event-driven spiking computation. However, some foundation SNN backbones (including Spikformer and SEW ResNet) suffer from non-spike computations (integer-float multiplications) caused by the structure of their residual connections. These non-spike computations increase SNNs' power consumption and make them unsuitable for deployment on mainstream neuromorphic hardware. In this paper, we analyze the spike-driven behavior of the residual connection methods in SNNs. We then present Spikingformer, a novel spiking transformer backbone that merges the MS Residual connection with Self-Attention in a biologically plausible way to address the non-spike computation challenge in Spikformer while maintaining global modeling capabilities. We evaluate Spikingformer across 13 datasets spanning large static images, neuromorphic data, and natural language tasks, and demonstrate the effectiveness and universality of Spikingformer, setting a vital benchmark for spiking neural networks. In addition, with the spike-driven features and global modeling capabilities, Spikingformer is expected to become a more efficient general-purpose SNN backbone towards energy-efficient artificial intelligence.

Zitieren

APA

Zhou, C., Yu, L., Zhou, Z., Zhang, H., Wang, J., Zhou, H., Ma, Z., & Tian, Y. (2026). Spikingformer: A Key Foundation Model for Spiking Neural Networks. Proceedings of the AAAI Conference on Artificial Intelligence, 40(3), 2236-2244. https://doi.org/10.1609/aaai.v40i3.37207

Vancouver

Zhou C, Yu L, Zhou Z, Zhang H, Wang J, Zhou H, et al. Spikingformer: A Key Foundation Model for Spiking Neural Networks. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(3):2236-2244. doi:10.1609/aaai.v40i3.37207

BibTeX
@article{Zhou2026,
  author = {Zhou, Chenlin and Yu, Liutao and Zhou, Zhaokun and Zhang, Han and Wang, Jiaqi and Zhou, Huihui and Ma, Zhengyu and Tian, Yonghong},
  title = {Spikingformer: A Key Foundation Model for Spiking Neural Networks},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {3},
  pages = {2236--2244},
  doi = {10.1609/aaai.v40i3.37207}
}
Kostenlos starten →