Artificial visual‐tactile perception array for enhanced memory and neuromorphic computations
InfoMat · 2024-03 · 6 (3)
DOI: 10.1002/inf2.12493 ↗Kurz gefasst
Fachartikel in der Zeitschrift InfoMat, online erschienen am 05.11.2023. Verfasst von Jiaqi He und 8 weiteren Autor:innen. Die Arbeit wurde bisher 108-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Beijing Municipality, National Key Research and Development Program of China.
Abstract (Originalsprache)
The emulation of human multisensory functions to construct artificial perception systems is an intriguing challenge for developing humanoid robotics and cross‐modal human–machine interfaces. Inspired by human multisensory signal generation and neuroplasticity‐based signal processing, here, an artificial perceptual neuro array with visual‐tactile sensing, processing, learning, and memory is demonstrated. The neuromorphic bimodal perception array compactly combines an artificial photoelectric synapse network and an integrated mechanoluminescent layer, endowing individual and synergistic plastic modulation of optical and mechanical information, including short‐term memory, long‐term memory, paired pulse facilitation, and “learning‐experience” behavior. Sequential or superimposed visual and tactile stimuli inputs can efficiently simulate the associative learning process of “Pavlov's dog”. The fusion of visual and tactile modulation enables enhanced memory of the stimulation image during the learning process. A machine‐learning algorithm is coupled with an artificial neural network for pattern recognition, achieving a recognition accuracy of 70% for bimodal training, which is higher than that obtained by unimodal training. In addition, the artificial perceptual neuron has a low energy consumption of ∼20 pJ. With its mechanical compliance and simple architecture, the neuromorphic bimodal perception array has promising applications in large‐scale cross‐modal interactions and high‐throughput intelligent perceptions. image
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Beijing Municipality
- National Key Research and Development Program of China
- Fundamental Research Funds for the Central Universities
Zitieren
APA
He, J., Wei, R., Ge, S., Wu, W., Guo, J., Tao, J., Wang, R., Wang, C., & Pan, C. (2024). Artificial visual‐tactile perception array for enhanced memory and neuromorphic computations. InfoMat, 6(3). https://doi.org/10.1002/inf2.12493
Vancouver
He J, Wei R, Ge S, Wu W, Guo J, Tao J, et al. Artificial visual‐tactile perception array for enhanced memory and neuromorphic computations. InfoMat. 2024;6(3). doi:10.1002/inf2.12493
BibTeX
@article{He2024,
author = {He, Jiaqi and Wei, Ruilai and Ge, Shuaipeng and Wu, Wenqiang and Guo, Jianchao and Tao, Juan and Wang, Ru and Wang, Chunfeng and Pan, Caofeng},
title = {Artificial visual‐tactile perception array for enhanced memory and neuromorphic computations},
journal = {InfoMat},
year = {2024},
volume = {6},
number = {3},
doi = {10.1002/inf2.12493}
}
EUVIMED