FlexPWL: A Flexible, Scalable, and Multiplier-Free Approach for Activation Functions on FPGA
IEEE Transactions on Computers · 2026-08 · 75 (8) · 3031-3039
DOI: 10.1109/tc.2026.3700077 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Computers, 2026-08. Verfasst von Ebrahim Fard und 3 weiteren Autor:innen. Die Arbeit nennt 24 Literaturangaben. Gefördert von: NSERC DG, Technology Innovation Program, Ministry of Trade, Industry and Energy of the Republic of Korea.
Abstract (Originalsprache)
The hardware implementation of nonlinear activation functions (AFs), such as the Sigmoid and Hyperbolic Tangent (Tanh), presents a significant bottleneck for deploying Recurrent Neural Networks (RNNs) on resource-constrained edge devices. Field Programmable Gate Arrays (FPGAs), as a leading platform for edge AI, face challenges in efficiently executing these functions due to their complex mathematical nature and limited computational resources. This paper proposes a novel, hardware-friendly piecewise linear (PWL) approximation method for implementing Sigmoid and Tanh functions. Our approach introduces new mathematical formulations for computing the y-intercept that significantly reduce Mean Squared Error (MSE) and Maximum Absolute Error (MXE) at no additional hardware cost. By consolidating the features of recent works, the proposed architecture eliminates a costly segment address encoder, supports pipelining for low-latency and high-frequency operation, and avoids the complexity and low precision of other methods. Moreover, it offers high configurability in bit width, number of segments, and input ranges, enabling adaptable deployment across diverse hardware and precision targets. A unified architecture is presented for both AFs, maintaining identical FPGA resource usage across functions. Experimental results demonstrate that the proposed method outperforms prior state-of-the-art designs by up to 18.52× in accuracy, 437.29× in latency, and 3.71× in frequency, and achieves LUT and flip-flop savings of up to 11.63× and 12.42×, respectively.
Förderung
- NSERC DG
- Technology Innovation Program
- Ministry of Trade, Industry and Energy of the Republic of Korea
Zitieren
APA
Fard, E., Arias-Garcia, J., Zhang, H., & Ko, S. (2026). FlexPWL: A Flexible, Scalable, and Multiplier-Free Approach for Activation Functions on FPGA. IEEE Transactions on Computers, 75(8), 3031-3039. https://doi.org/10.1109/tc.2026.3700077
Vancouver
Fard E, Arias-Garcia J, Zhang H, Ko S. FlexPWL: A Flexible, Scalable, and Multiplier-Free Approach for Activation Functions on FPGA. IEEE Transactions on Computers. 2026;75(8):3031-3039. doi:10.1109/tc.2026.3700077
BibTeX
@article{Fard2026,
author = {Fard, Ebrahim and Arias-Garcia, Janier and Zhang, Hao and Ko, Seokbum},
title = {FlexPWL: A Flexible, Scalable, and Multiplier-Free Approach for Activation Functions on FPGA},
journal = {IEEE Transactions on Computers},
year = {2026},
volume = {75},
number = {8},
pages = {3031--3039},
doi = {10.1109/tc.2026.3700077}
}
EUVIMED