Intrinsic Decay Property of Ti/TiO x /Pt Memristor for Reinforcement Learning
Advanced Intelligent Systems · 2023-07 · 5 (7)
DOI: 10.1002/aisy.202200455 ↗Kurz gefasst
Fachartikel in der Zeitschrift Advanced Intelligent Systems, online erschienen am 07.04.2023. Verfasst von Yuehua Dai und 6 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Innovative Research Group Project of the National Natural Science Foundation of China, Natural Science Foundation of Anhui Province.
Abstract (Originalsprache)
A memristor‐based reinforcement learning (RL) system has shown outstanding performance in achieving efficient autonomous decision‐making and edge computing. Sarsa ( λ ) is a classical multistep RL algorithm that records state with λ decay and guides policy updates, significantly improving the algorithm convergence speed. However, λ decay implementation of traditional computing hardware is confined by the extensive computation of power exponential decay. Herein, the value update equation for Sarsa ( λ ) is implemented by using the topological structure of the memristor array, without complex circuits. Where, most importantly, the critical λ decay function is realized by a TiO x ‐based memristor with conductance decay property. The energy required for floating‐point operations can be significantly reduced while accelerating the convergence speed. Then, a path planning task is demonstrated based on intrinsic conductance decay property and shows outstanding performance. Finally, the information of rounds used for the task is obtained, which is based on the intrinsic decay property of the TiO x ‐based memristor, maps into a 32 × 32 memristor array in parallel to calculate the value of each round. The results indicate that the experimental data have similar results to the simulations. Herein, thus, it provides a hardware‐enabled scheme for the memristor‐based RL algorithm implementation.
Förderung
- Innovative Research Group Project of the National Natural Science Foundation of China
- Natural Science Foundation of Anhui Province
Zitieren
APA
Dai, Y., Guo, W., Feng, Z., Xu, Z., Zhu, Y., Yang, F., & Wu, Z. (2023). Intrinsic Decay Property of Ti/TiO x /Pt Memristor for Reinforcement Learning. Advanced Intelligent Systems, 5(7). https://doi.org/10.1002/aisy.202200455
Vancouver
Dai Y, Guo W, Feng Z, Xu Z, Zhu Y, Yang F, et al. Intrinsic Decay Property of Ti/TiO x /Pt Memristor for Reinforcement Learning. Advanced Intelligent Systems. 2023;5(7). doi:10.1002/aisy.202200455
BibTeX
@article{Dai2023,
author = {Dai, Yuehua and Guo, Wenbin and Feng, Zhe and Xu, Zuyu and Zhu, Yunlai and Yang, Fei and Wu, Zuheng},
title = {Intrinsic Decay Property of Ti/TiO x /Pt Memristor for Reinforcement Learning},
journal = {Advanced Intelligent Systems},
year = {2023},
volume = {5},
number = {7},
doi = {10.1002/aisy.202200455}
}
EUVIMED