A Spiking Artificial Vision Architecture Based on Fully Emulating the Human Vision
Advanced Materials · 2024-05 · 36 (19)
DOI: 10.1002/adma.202312094 ↗Kurz gefasst
Fachartikel in der Zeitschrift Advanced Materials, online erschienen am 13.02.2024. Verfasst von Yi Wu und 7 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Materials and Manufacturing, Beijing University of Technology, Beijing, 100124, China. Hauptthemen laut MEDLINE: Vision, Ocular, Neural Networks, Computer. Die Arbeit wurde bisher 32-mal zitiert (Crossref) und nennt 37 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Postdoctoral Program for Innovative Talents, China Postdoctoral Science Foundation.
Abstract (Originalsprache)
Intelligent vision necessitates the deployment of detectors that are always‐on and low‐power, mirroring the continuous and uninterrupted responsiveness characteristic of human vision. Nonetheless, contemporary artificial vision systems attain this goal by the continuous processing of massive image frames and executing intricate algorithms, thereby expending substantial computational power and energy. In contrast, biological data processing, based on event‐triggered spiking, has higher efficiency and lower energy consumption. Here, this work proposes an artificial vision architecture consisting of spiking photodetectors and artificial synapses, closely mirroring the intricacies of the human visual system. Distinct from previously reported techniques, the photodetector is self‐powered and event‐triggered, outputting light‐modulated spiking signals directly, thereby fulfilling the imperative for always‐on with low‐power consumption. With the spiking signals processing through the integrated synapse units, recognition of graphics, gestures, and human action has been implemented, illustrating the potent image processing capabilities inherent within this architecture. The results prove the 90% accuracy rate in human action recognition within a mere five epochs utilizing a rudimentary artificial neural network. This novel architecture, grounded in spiking photodetectors, offers a viable alternative to the extant models of always‐on low‐power artificial vision system.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Materials and Manufacturing, Beijing University of Technology, Beijing, 100124, China.
- Key Laboratory of Optoelectronics Technology of Education Ministry of China, Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China.
ORCID-Profile: Yongzhe Zhang
Förderung
- National Natural Science Foundation of China
- National Postdoctoral Program for Innovative Talents
- China Postdoctoral Science Foundation
Zitieren
APA
Wu, Y., Deng, W., Li, K., Wang, X., Liu, B., Li, J., Chen, Z., & Zhang, Y. (2024). A Spiking Artificial Vision Architecture Based on Fully Emulating the Human Vision. Advanced Materials, 36(19). https://doi.org/10.1002/adma.202312094
Vancouver
Wu Y, Deng W, Li K, Wang X, Liu B, Li J, et al. A Spiking Artificial Vision Architecture Based on Fully Emulating the Human Vision. Advanced Materials. 2024;36(19). doi:10.1002/adma.202312094
BibTeX
@article{Wu2024,
author = {Wu, Yi and Deng, Wenjie and Li, Kexin and Wang, Xiaoting and Liu, Bo and Li, Jingzhen and Chen, Zhijie and Zhang, Yongzhe},
title = {A Spiking Artificial Vision Architecture Based on Fully Emulating the Human Vision},
journal = {Advanced Materials},
year = {2024},
volume = {36},
number = {19},
doi = {10.1002/adma.202312094}
}
EUVIMED