Implementation of the SoftMax Activation for Reconfigurable Neural Network Hardware Accelerators
Applied Sciences · 28.11.2023 · 13 (23) · 12784
DOI: 10.3390/app132312784 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 28.11.2023. Verfasst von Vladislav Shatravin und 2 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Tomsk State University Development Programme.
Abstract (Originalsprache)
In recent decades, machine-learning algorithms have been extensively utilized to tackle various complex tasks. To achieve the high performance and efficiency of these algorithms, various hardware accelerators are used. Typically, these devices are specialized for specific neural network architectures and activation functions. However, state-of-the-art complex autonomous and mobile systems may require different algorithms for different tasks. Reconfigurable accelerators can be used to resolve this problem. They possess the capability to support diverse neural network architectures and allow for significant alterations to the implemented model at runtime. Thus, a single device can be used to address entirely different tasks. Our research focuses on dynamically reconfigurable accelerators based on reconfigurable computing environments (RCE). To implement the required neural networks on such devices, their algorithms need to be adapted to the homogeneous structure of RCE. This article proposes the first implementation of the widely used SoftMax activation for hardware accelerators based on RCE. The implementation leverages spatial distribution and incorporates several optimizations to enhance its performance. The timing simulation of the proposed implementation on FPGA shows a high throughput of 1.12 Gbps at 23 MHz. The result is comparable to counterparts lacking reconfiguration capability. However, this flexibility comes at the expense of the increased consumption of logic elements.
Förderung
- Tomsk State University Development Programme
Zitieren
APA
Shatravin, V., Shashev, D., & Shidlovskiy, S. (2023). Implementation of the SoftMax Activation for Reconfigurable Neural Network Hardware Accelerators. Applied Sciences, 13(23), 12784. https://doi.org/10.3390/app132312784
Vancouver
Shatravin V, Shashev D, Shidlovskiy S. Implementation of the SoftMax Activation for Reconfigurable Neural Network Hardware Accelerators. Applied Sciences. 2023;13(23):12784. doi:10.3390/app132312784
BibTeX
@article{Shatravin2023,
author = {Shatravin, Vladislav and Shashev, Dmitriy and Shidlovskiy, Stanislav},
title = {Implementation of the SoftMax Activation for Reconfigurable Neural Network Hardware Accelerators},
journal = {Applied Sciences},
year = {2023},
volume = {13},
number = {23},
pages = {12784},
doi = {10.3390/app132312784}
}
EUVIMED