Stream: Design Space Exploration of Layer-Fused DNNs on Heterogeneous Dataflow Accelerators
IEEE Transactions on Computers · 2025-01 · 74 (1) · 237-249
DOI: 10.1109/tc.2024.3477938 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Computers, 2025-01. Verfasst von Arne Symons und 5 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 41 Literaturangaben.
Abstract (Originalsprache)
As the landscape of deep neural networks evolves, heterogeneous dataflow accelerators, in the form of multi-core architectures or chiplet-based designs, promise more flexibility and higher inference performance through scalability. So far, these systems exploit the increased parallelism by coarsely mapping a single layer at a time across cores, which incurs frequent costly off-chip memory accesses, or by pipelining batches of inputs, which falls short in meeting the demands of latency-critical applications. To alleviate these bottlenecks, this work explores a new fine-grain mapping paradigm, referred to as layer fusion, on heterogeneous dataflow accelerators through a novel design space exploration framework called Stream . Stream captures a wide variety of heterogeneous dataflow architectures and mapping granularities, and implements a memory and communication-aware latency and energy analysis validated with three distinct state-of-the-art hardware implementations. As such, it facilitates a holistic exploration of architecture and mapping, by strategically allocating the workload through constraint optimization. The findings demonstrate that the integration of layer fusion with heterogeneous dataflow accelerators yields up to $2.2\times$ 2.2 × lower energy-delay product in inference efficiency, addressing both energy consumption and latency concerns. The framework is available open-source at: github.com/kuleuven-micas/stream.
Zitieren
APA
Symons, A., Mei, L., Colleman, S., Houshmand, P., Karl, S., & Verhelst, M. (2025). Stream: Design Space Exploration of Layer-Fused DNNs on Heterogeneous Dataflow Accelerators. IEEE Transactions on Computers, 74(1), 237-249. https://doi.org/10.1109/tc.2024.3477938
Vancouver
Symons A, Mei L, Colleman S, Houshmand P, Karl S, Verhelst M. Stream: Design Space Exploration of Layer-Fused DNNs on Heterogeneous Dataflow Accelerators. IEEE Transactions on Computers. 2025;74(1):237-249. doi:10.1109/tc.2024.3477938
BibTeX
@article{Symons2025,
author = {Symons, Arne and Mei, Linyan and Colleman, Steven and Houshmand, Pouya and Karl, Sebastian and Verhelst, Marian},
title = {Stream: Design Space Exploration of Layer-Fused DNNs on Heterogeneous Dataflow Accelerators},
journal = {IEEE Transactions on Computers},
year = {2025},
volume = {74},
number = {1},
pages = {237--249},
doi = {10.1109/tc.2024.3477938}
}
EUVIMED