NxTF: An API and Compiler for Deep Spiking Neural Networks on Intel Loihi
ACM Journal on Emerging Technologies in Computing Systems · 31.07.2022 · 18 (3) · 1-22
DOI: 10.1145/3501770 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Journal on Emerging Technologies in Computing Systems, online erschienen am 29.01.2022. Verfasst von Bodo Rueckauer und 5 weiteren Autor:innen. Die Arbeit wurde bisher 59-mal zitiert (Crossref) und nennt 42 Literaturangaben. Gefördert von: SNSF, Samsung Advanced Institute of Technology, National Science Foundation Graduate Research Fellowship.
Abstract (Originalsprache)
Spiking Neural Networks (SNNs) is a promising paradigm for efficient event-driven processing of spatio-temporally sparse data streams. Spiking Neural Networks (SNNs) have inspired the design of and can take advantage of the emerging class of neuromorphic processors like Intel Loihi. These novel hardware architectures expose a variety of constraints that affect firmware, compiler, and algorithm development alike. To enable rapid and flexible development of SNN algorithms on Loihi, we developed NxTF: a programming interface derived from Keras and compiler optimized for mapping deep convolutional SNNs to the multi-core Intel Loihi architecture. We evaluate NxTF on Deep Neural Networks (DNNs) trained directly on spikes as well as models converted from traditional DNNs, processing both sparse event-based and dense frame-based datasets. Further, we assess the effectiveness of the compiler to distribute models across a large number of cores and to compress models by exploiting Loihi’s weight-sharing features. Finally, we evaluate model accuracy, energy, and time-to-solution compared to other architectures. The compiler achieves near-optimal resource utilization of 80% across 16 Loihi chips for a 28-layer, 4M parameter MobileNet model with input size 128×128. In addition, we report the lowest error rate of 8.52% for the CIFAR-10 dataset on neuromorphic hardware, using an off-the-shelf MobileNet.
Förderung
- SNSF
- Samsung Advanced Institute of Technology
- National Science Foundation Graduate Research Fellowship
Zitieren
APA
Rueckauer, B., Bybee, C., Goettsche, R., Singh, Y., Mishra, J., & Wild, A. (2022). NxTF: An API and Compiler for Deep Spiking Neural Networks on Intel Loihi. ACM Journal on Emerging Technologies in Computing Systems, 18(3), 1-22. https://doi.org/10.1145/3501770
Vancouver
Rueckauer B, Bybee C, Goettsche R, Singh Y, Mishra J, Wild A. NxTF: An API and Compiler for Deep Spiking Neural Networks on Intel Loihi. ACM Journal on Emerging Technologies in Computing Systems. 2022;18(3):1-22. doi:10.1145/3501770
BibTeX
@article{Rueckauer2022,
author = {Rueckauer, Bodo and Bybee, Connor and Goettsche, Ralf and Singh, Yashwardhan and Mishra, Joyesh and Wild, Andreas},
title = {NxTF: An API and Compiler for Deep Spiking Neural Networks on Intel Loihi},
journal = {ACM Journal on Emerging Technologies in Computing Systems},
year = {2022},
volume = {18},
number = {3},
pages = {1--22},
doi = {10.1145/3501770}
}
EUVIMED