EUVIMEDEUVIMED entdecken
Crossref

Hardware Approximate Techniques for Deep Neural Network Accelerators: A Survey

Giorgos Armeniakos, Georgios Zervakis, Dimitrios Soudris, Jörg Henkel

ACM Computing Surveys · 30.04.2023 · 55 (4) · 1-36

DOI: 10.1145/3527156 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 21.11.2022. Verfasst von Giorgos Armeniakos und 3 weiteren Autor:innen. Die Arbeit wurde bisher 141-mal zitiert (Crossref) und nennt 139 Literaturangaben. Gefördert von: German Research Foundation, ACCROSS: Approximate Computing aCROss the System Stack.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep Neural Networks (DNNs) are very popular because of their high performance in various cognitive tasks in Machine Learning (ML). Recent advancements in DNNs have brought levels beyond human accuracy in many tasks, but at the cost of high computational complexity. To enable efficient execution of DNN inference, more and more research works, therefore, are exploiting the inherent error resilience of DNNs and employing Approximate Computing (AC) principles to address the elevated energy demands of DNN accelerators. This article provides a comprehensive survey and analysis of hardware approximation techniques for DNN accelerators. First, we analyze the state of the art, and by identifying approximation families, we cluster the respective works with respect to the approximation type. Next, we analyze the complexity of the performed evaluations (with respect to the dataset and DNN size) to assess the efficiency, potential, and limitations of approximate DNN accelerators. Moreover, a broad discussion is provided regarding error metrics that are more suitable for designing approximate units for DNN accelerators as well as accuracy recovery approaches that are tailored to DNN inference. Finally, we present how Approximate Computing for DNN accelerators can go beyond energy efficiency and address reliability and security issues as well.

Förderung

  • German Research Foundation
  • ACCROSS: Approximate Computing aCROss the System Stack

Zitieren

APA

Armeniakos, G., Zervakis, G., Soudris, D., & Henkel, J. (2023). Hardware Approximate Techniques for Deep Neural Network Accelerators: A Survey. ACM Computing Surveys, 55(4), 1-36. https://doi.org/10.1145/3527156

Vancouver

Armeniakos G, Zervakis G, Soudris D, Henkel J. Hardware Approximate Techniques for Deep Neural Network Accelerators: A Survey. ACM Computing Surveys. 2023;55(4):1-36. doi:10.1145/3527156

BibTeX
@article{Armeniakos2023,
  author = {Armeniakos, Giorgos and Zervakis, Georgios and Soudris, Dimitrios and Henkel, Jörg},
  title = {Hardware Approximate Techniques for Deep Neural Network Accelerators: A Survey},
  journal = {ACM Computing Surveys},
  year = {2023},
  volume = {55},
  number = {4},
  pages = {1--36},
  doi = {10.1145/3527156}
}
Kostenlos starten →