EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Artificial visual‐tactile perception array for enhanced memory and neuromorphic computations

Jiaqi He, Ruilai Wei, Shuaipeng Ge, Wenqiang Wu, Jianchao Guo, Juan Tao, Ru Wang, Chunfeng Wang, Caofeng Pan

InfoMat · 2024-03 · 6 (3)

DOI: 10.1002/inf2.12493 ↗

Kurz gefasst

Fachartikel in der Zeitschrift InfoMat, online erschienen am 05.11.2023. Verfasst von Jiaqi He und 8 weiteren Autor:innen. Die Arbeit wurde bisher 108-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Beijing Municipality, National Key Research and Development Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The emulation of human multisensory functions to construct artificial perception systems is an intriguing challenge for developing humanoid robotics and cross‐modal human–machine interfaces. Inspired by human multisensory signal generation and neuroplasticity‐based signal processing, here, an artificial perceptual neuro array with visual‐tactile sensing, processing, learning, and memory is demonstrated. The neuromorphic bimodal perception array compactly combines an artificial photoelectric synapse network and an integrated mechanoluminescent layer, endowing individual and synergistic plastic modulation of optical and mechanical information, including short‐term memory, long‐term memory, paired pulse facilitation, and “learning‐experience” behavior. Sequential or superimposed visual and tactile stimuli inputs can efficiently simulate the associative learning process of “Pavlov's dog”. The fusion of visual and tactile modulation enables enhanced memory of the stimulation image during the learning process. A machine‐learning algorithm is coupled with an artificial neural network for pattern recognition, achieving a recognition accuracy of 70% for bimodal training, which is higher than that obtained by unimodal training. In addition, the artificial perceptual neuron has a low energy consumption of ∼20 pJ. With its mechanical compliance and simple architecture, the neuromorphic bimodal perception array has promising applications in large‐scale cross‐modal interactions and high‐throughput intelligent perceptions. image

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of Beijing Municipality
  • National Key Research and Development Program of China
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

He, J., Wei, R., Ge, S., Wu, W., Guo, J., Tao, J., Wang, R., Wang, C., & Pan, C. (2024). Artificial visual‐tactile perception array for enhanced memory and neuromorphic computations. InfoMat, 6(3). https://doi.org/10.1002/inf2.12493

Vancouver

He J, Wei R, Ge S, Wu W, Guo J, Tao J, et al. Artificial visual‐tactile perception array for enhanced memory and neuromorphic computations. InfoMat. 2024;6(3). doi:10.1002/inf2.12493

BibTeX
@article{He2024,
  author = {He, Jiaqi and Wei, Ruilai and Ge, Shuaipeng and Wu, Wenqiang and Guo, Jianchao and Tao, Juan and Wang, Ru and Wang, Chunfeng and Pan, Caofeng},
  title = {Artificial visual‐tactile perception array for enhanced memory and neuromorphic computations},
  journal = {InfoMat},
  year = {2024},
  volume = {6},
  number = {3},
  doi = {10.1002/inf2.12493}
}
Kostenlos starten →