Energy-efficient FPGA acceleration of reinforcement learning algorithms using high-level synthesis
International Review of Applied Sciences and Engineering · 05.11.2026 · 17 (3) · 430-439
DOI: 10.1556/1848.2026.01404 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Review of Applied Sciences and Engineering, erschienen am 05.11.2026. Verfasst von Umamaheswari Ramalingam und 3 weiteren Autor:innen. Die Arbeit nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Low latency and energy-efficient design are important requirements for Reinforcement Learning (RL) algorithms deployed on embedded and edge computing systems. Software based Q-learning shows increased power consumption as well as the overhead of sequential execution. The paper shows an energy-efficient FPGA architecture for the Q-learning update based on High Level Synthesis (HLS). An FPGA accelerator targeting the device platform Xilinx Zynq-7000 (xc7z020clg400-1) has been designed and implemented. Loop pipelining and precision fine-tuning design techniques were applied to optimize the architecture. This improvement was achieved by 50 percent as a baseline architecture got a latency of 14 cycles, which was reduced to 7 cycles when the architecture was pipelined with loops. A relative comparison of fixed point (ap_fixed) and floating point implementations has shown that the floating point arithmetic increases the number of LUTs used by 4 times, the number of DSPs used by more than 2 times, and the delay by 29 cycles. Post implementation power analysis for fixed-point architecture shows that its energy consumption is about 4 times less per Q-update operation than a floating-point design. The results show that pipelined fixed-point FPGA architectures are a good solution to speed up the reinforcement learning process in resource-limited embedded systems.
Zitieren
APA
Ramalingam, U., S, N., Chan, K., & Lee, L. (2026). Energy-efficient FPGA acceleration of reinforcement learning algorithms using high-level synthesis. International Review of Applied Sciences and Engineering, 17(3), 430-439. https://doi.org/10.1556/1848.2026.01404
Vancouver
Ramalingam U, S N, Chan K, Lee L. Energy-efficient FPGA acceleration of reinforcement learning algorithms using high-level synthesis. International Review of Applied Sciences and Engineering. 2026;17(3):430-439. doi:10.1556/1848.2026.01404
BibTeX
@article{Ramalingam2026,
author = {Ramalingam, Umamaheswari and S, Navaneethan and Chan, Kah-Yoong and Lee, Lini},
title = {Energy-efficient FPGA acceleration of reinforcement learning algorithms using high-level synthesis},
journal = {International Review of Applied Sciences and Engineering},
year = {2026},
volume = {17},
number = {3},
pages = {430--439},
doi = {10.1556/1848.2026.01404}
}
EUVIMED