EUVIMEDEUVIMED entdecken
Crossref

Overflow-free Compute Memories for Edge AI Acceleration

Flavio Ponzina, Marco Rios, Alexandre Levisse, Giovanni Ansaloni, David Atienza

ACM Transactions on Embedded Computing Systems · 31.10.2023 · 22 (5s) · 1-23

DOI: 10.1145/3609387 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Embedded Computing Systems, online erschienen am 09.09.2023. Verfasst von Flavio Ponzina und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: EC H2020 WiPLASH, EC H2020 FVLLMONTI, ACCESS – AI Chip Center for Emerging Smart Systems.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Compute memories are memory arrays augmented with dedicated logic to support arithmetic. They support the efficient execution of data-centric computing patterns, such as those characterizing Artificial Intelligence (AI) algorithms. These architectures can provide computing capabilities as part of the memory array structures (In-Memory Computing, IMC) or at their immediate periphery (Near-Memory Computing, NMC). By bringing the processing elements inside (or very close to) storage, compute memories minimize the cost of data access. Moreover, highly parallel (and, hence, high-performance) computations are enabled by exploiting the regular structure of memory arrays. However, the regular layout of memory elements also constrains the data range of inputs and outputs, since the bitwidths of operands and results stored at each address cannot be freely varied. Addressing this challenge, we herein propose a HW/SW co-design methodology combining careful per-layer quantization and inter-layer scaling with lightweight hardware support for overflow-free computation of dot-vector operations. We demonstrate their use to implement the convolutional and fully connected layers of AI models. We embody our strategy in two implementations, based on IMC and NMC, respectively. Experimental results highlight that an area overhead of only 10.5% (for IMC) and 12.9% (for NMC) is required when interfacing with a 2KB subarray. Furthermore, inferences on benchmark CNNs show negligible accuracy degradation due to quantization for equivalent floating-point implementations.

Förderung

  • EC H2020 WiPLASH
  • EC H2020 FVLLMONTI
  • ACCESS – AI Chip Center for Emerging Smart Systems

Zitieren

APA

Ponzina, F., Rios, M., Levisse, A., Ansaloni, G., & Atienza, D. (2023). Overflow-free Compute Memories for Edge AI Acceleration. ACM Transactions on Embedded Computing Systems, 22(5s), 1-23. https://doi.org/10.1145/3609387

Vancouver

Ponzina F, Rios M, Levisse A, Ansaloni G, Atienza D. Overflow-free Compute Memories for Edge AI Acceleration. ACM Transactions on Embedded Computing Systems. 2023;22(5s):1-23. doi:10.1145/3609387

BibTeX
@article{Ponzina2023,
  author = {Ponzina, Flavio and Rios, Marco and Levisse, Alexandre and Ansaloni, Giovanni and Atienza, David},
  title = {Overflow-free Compute Memories for Edge AI Acceleration},
  journal = {ACM Transactions on Embedded Computing Systems},
  year = {2023},
  volume = {22},
  number = {5s},
  pages = {1--23},
  doi = {10.1145/3609387}
}
Kostenlos starten →