EUVIMEDEUVIMED entdecken
Crossref

SpiReco: Fast and Efficient Recognition of High-Speed Moving Objects With Spike Camera

Junwei Zhao, Shiliang Zhang, Zhaofei Yu, Tiejun Huang

IEEE Transactions on Circuits and Systems for Video Technology · 2024-07 · 34 (7) · 5856-5867

DOI: 10.1109/tcsvt.2023.3272375 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-07. Verfasst von Junwei Zhao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: National Key Research and Development Program of China, Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Benefited from the high temporal resolution and high dynamic range, spike cameras have shown great potential in recognizing high-speed moving objects. However, the computer vision community has not explored this task due to the lack of spike data and annotations of high-speed moving objects. This paper contributes a novel dataset, named SpiReco (Spiking datasets for Recognition), by recording high-speed moving objects using a spike camera. To annotate the dataset, image labels from established datasets such as MNIST, CIFAR10, and CALTECH101 are utilized. Based on this new dataset, this paper proposes the first spike-based object recognition framework. The proposed framework includes a denoise module, which is designed to suppress spike noise by learning spatio-temporal correlation from neighbouring pixels. Additionally, a motion enhancement module is introduced to address high-speed and random motions. Afterwards, binarized neural networks are adopted to save computation costs. These efforts result in a fast and efficient processing framework for spiking data. Experimental results demonstrate the effectiveness of the proposed methods. For example, the proposed spike-based recognition framework achieves 80.2% accuracy in recognizing 101 classes of high-speed moving objects using only 2.2ms of spike streams. The SpiReco is available at https://github.com/Evin-X/SpiReco.

Förderung

  • National Key Research and Development Program of China
  • Natural Science Foundation of China

Zitieren

APA

Zhao, J., Zhang, S., Yu, Z., & Huang, T. (2024). SpiReco: Fast and Efficient Recognition of High-Speed Moving Objects With Spike Camera. IEEE Transactions on Circuits and Systems for Video Technology, 34(7), 5856-5867. https://doi.org/10.1109/tcsvt.2023.3272375

Vancouver

Zhao J, Zhang S, Yu Z, Huang T. SpiReco: Fast and Efficient Recognition of High-Speed Moving Objects With Spike Camera. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(7):5856-5867. doi:10.1109/tcsvt.2023.3272375

BibTeX
@article{Zhao2024,
  author = {Zhao, Junwei and Zhang, Shiliang and Yu, Zhaofei and Huang, Tiejun},
  title = {SpiReco: Fast and Efficient Recognition of High-Speed Moving Objects With Spike Camera},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {7},
  pages = {5856--5867},
  doi = {10.1109/tcsvt.2023.3272375}
}
Kostenlos starten →