Spikingformer: A Key Foundation Model for Spiking Neural Networks
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (3) · 2236-2244
DOI: 10.1609/aaai.v40i3.37207 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Chenlin Zhou und 7 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref).
Abstract (Originalsprache)
Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial neural networks, due to their event-driven spiking computation. However, some foundation SNN backbones (including Spikformer and SEW ResNet) suffer from non-spike computations (integer-float multiplications) caused by the structure of their residual connections. These non-spike computations increase SNNs' power consumption and make them unsuitable for deployment on mainstream neuromorphic hardware. In this paper, we analyze the spike-driven behavior of the residual connection methods in SNNs. We then present Spikingformer, a novel spiking transformer backbone that merges the MS Residual connection with Self-Attention in a biologically plausible way to address the non-spike computation challenge in Spikformer while maintaining global modeling capabilities. We evaluate Spikingformer across 13 datasets spanning large static images, neuromorphic data, and natural language tasks, and demonstrate the effectiveness and universality of Spikingformer, setting a vital benchmark for spiking neural networks. In addition, with the spike-driven features and global modeling capabilities, Spikingformer is expected to become a more efficient general-purpose SNN backbone towards energy-efficient artificial intelligence.
Zitieren
APA
Zhou, C., Yu, L., Zhou, Z., Zhang, H., Wang, J., Zhou, H., Ma, Z., & Tian, Y. (2026). Spikingformer: A Key Foundation Model for Spiking Neural Networks. Proceedings of the AAAI Conference on Artificial Intelligence, 40(3), 2236-2244. https://doi.org/10.1609/aaai.v40i3.37207
Vancouver
Zhou C, Yu L, Zhou Z, Zhang H, Wang J, Zhou H, et al. Spikingformer: A Key Foundation Model for Spiking Neural Networks. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(3):2236-2244. doi:10.1609/aaai.v40i3.37207
BibTeX
@article{Zhou2026,
author = {Zhou, Chenlin and Yu, Liutao and Zhou, Zhaokun and Zhang, Han and Wang, Jiaqi and Zhou, Huihui and Ma, Zhengyu and Tian, Yonghong},
title = {Spikingformer: A Key Foundation Model for Spiking Neural Networks},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {3},
pages = {2236--2244},
doi = {10.1609/aaai.v40i3.37207}
}
EUVIMED