EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Intrinsic Decay Property of Ti/TiO x /Pt Memristor for Reinforcement Learning

Yuehua Dai, Wenbin Guo, Zhe Feng, Zuyu Xu, Yunlai Zhu, Fei Yang, Zuheng Wu

Advanced Intelligent Systems · 2023-07 · 5 (7)

DOI: 10.1002/aisy.202200455 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Advanced Intelligent Systems, online erschienen am 07.04.2023. Verfasst von Yuehua Dai und 6 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Innovative Research Group Project of the National Natural Science Foundation of China, Natural Science Foundation of Anhui Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A memristor‐based reinforcement learning (RL) system has shown outstanding performance in achieving efficient autonomous decision‐making and edge computing. Sarsa ( λ ) is a classical multistep RL algorithm that records state with λ decay and guides policy updates, significantly improving the algorithm convergence speed. However, λ decay implementation of traditional computing hardware is confined by the extensive computation of power exponential decay. Herein, the value update equation for Sarsa ( λ ) is implemented by using the topological structure of the memristor array, without complex circuits. Where, most importantly, the critical λ decay function is realized by a TiO x ‐based memristor with conductance decay property. The energy required for floating‐point operations can be significantly reduced while accelerating the convergence speed. Then, a path planning task is demonstrated based on intrinsic conductance decay property and shows outstanding performance. Finally, the information of rounds used for the task is obtained, which is based on the intrinsic decay property of the TiO x ‐based memristor, maps into a 32 × 32 memristor array in parallel to calculate the value of each round. The results indicate that the experimental data have similar results to the simulations. Herein, thus, it provides a hardware‐enabled scheme for the memristor‐based RL algorithm implementation.

Förderung

  • Innovative Research Group Project of the National Natural Science Foundation of China
  • Natural Science Foundation of Anhui Province

Zitieren

APA

Dai, Y., Guo, W., Feng, Z., Xu, Z., Zhu, Y., Yang, F., & Wu, Z. (2023). Intrinsic Decay Property of Ti/TiO x /Pt Memristor for Reinforcement Learning. Advanced Intelligent Systems, 5(7). https://doi.org/10.1002/aisy.202200455

Vancouver

Dai Y, Guo W, Feng Z, Xu Z, Zhu Y, Yang F, et al. Intrinsic Decay Property of Ti/TiO x /Pt Memristor for Reinforcement Learning. Advanced Intelligent Systems. 2023;5(7). doi:10.1002/aisy.202200455

BibTeX
@article{Dai2023,
  author = {Dai, Yuehua and Guo, Wenbin and Feng, Zhe and Xu, Zuyu and Zhu, Yunlai and Yang, Fei and Wu, Zuheng},
  title = {Intrinsic Decay Property of Ti/TiO x /Pt Memristor for Reinforcement Learning},
  journal = {Advanced Intelligent Systems},
  year = {2023},
  volume = {5},
  number = {7},
  doi = {10.1002/aisy.202200455}
}
Kostenlos starten →