SpiReco: Fast and Efficient Recognition of High-Speed Moving Objects With Spike Camera
IEEE Transactions on Circuits and Systems for Video Technology · 2024-07 · 34 (7) · 5856-5867
DOI: 10.1109/tcsvt.2023.3272375 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-07. Verfasst von Junwei Zhao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: National Key Research and Development Program of China, Natural Science Foundation of China.
Abstract (Originalsprache)
Benefited from the high temporal resolution and high dynamic range, spike cameras have shown great potential in recognizing high-speed moving objects. However, the computer vision community has not explored this task due to the lack of spike data and annotations of high-speed moving objects. This paper contributes a novel dataset, named SpiReco (Spiking datasets for Recognition), by recording high-speed moving objects using a spike camera. To annotate the dataset, image labels from established datasets such as MNIST, CIFAR10, and CALTECH101 are utilized. Based on this new dataset, this paper proposes the first spike-based object recognition framework. The proposed framework includes a denoise module, which is designed to suppress spike noise by learning spatio-temporal correlation from neighbouring pixels. Additionally, a motion enhancement module is introduced to address high-speed and random motions. Afterwards, binarized neural networks are adopted to save computation costs. These efforts result in a fast and efficient processing framework for spiking data. Experimental results demonstrate the effectiveness of the proposed methods. For example, the proposed spike-based recognition framework achieves 80.2% accuracy in recognizing 101 classes of high-speed moving objects using only 2.2ms of spike streams. The SpiReco is available at https://github.com/Evin-X/SpiReco.
Förderung
- National Key Research and Development Program of China
- Natural Science Foundation of China
Zitieren
APA
Zhao, J., Zhang, S., Yu, Z., & Huang, T. (2024). SpiReco: Fast and Efficient Recognition of High-Speed Moving Objects With Spike Camera. IEEE Transactions on Circuits and Systems for Video Technology, 34(7), 5856-5867. https://doi.org/10.1109/tcsvt.2023.3272375
Vancouver
Zhao J, Zhang S, Yu Z, Huang T. SpiReco: Fast and Efficient Recognition of High-Speed Moving Objects With Spike Camera. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(7):5856-5867. doi:10.1109/tcsvt.2023.3272375
BibTeX
@article{Zhao2024,
author = {Zhao, Junwei and Zhang, Shiliang and Yu, Zhaofei and Huang, Tiejun},
title = {SpiReco: Fast and Efficient Recognition of High-Speed Moving Objects With Spike Camera},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2024},
volume = {34},
number = {7},
pages = {5856--5867},
doi = {10.1109/tcsvt.2023.3272375}
}
EUVIMED