Efficient Spiking Neural Network for RGB–Event Fusion-Based Object Detection
Electronics · 11.03.2025 · 14 (6) · 1105
DOI: 10.3390/electronics14061105 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 11.03.2025. Verfasst von Liangwei Fan und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Robust object detection in challenging scenarios remains a critical challenge for autonomous driving systems. Inspired by human visual perception, integrating the complementary modalities of RGB frames and event streams presents a promising approach to achieving robust object detection. However, existing multimodal object detectors achieve superior performance at the cost of significant computational power consumption. To address this challenge, we propose a novel spiking RGB–event fusion-based detection network (SFDNet), a fully spiking object detector capable of achieving both low-power and high-performance object detection. Specifically, we first introduce the Leaky Integrate-and-Multi-Fire (LIMF) neuron model, which combines soft and hard reset mechanisms to enhance feature representation in SNNs. We then develop a multi-scale hierarchical spiking residual attention network and a lightweight spiking aggregation module for efficient dual-modality feature extraction and fusion. Experimental results on two public multimodal object detection datasets demonstrate that our SFDNet achieves state-of-the-art performance with remarkably low power consumption. The superior performance in challenging scenarios, such as motion blur and low-light conditions, highlights the robustness and effectiveness of SFDNet, significantly advancing the applicability of SNNs for real-world object detection tasks.
Zitieren
APA
Fan, L., Yang, J., Wang, L., Zhang, J., Lian, X., & Shen, H. (2025). Efficient Spiking Neural Network for RGB–Event Fusion-Based Object Detection. Electronics, 14(6), 1105. https://doi.org/10.3390/electronics14061105
Vancouver
Fan L, Yang J, Wang L, Zhang J, Lian X, Shen H. Efficient Spiking Neural Network for RGB–Event Fusion-Based Object Detection. Electronics. 2025;14(6):1105. doi:10.3390/electronics14061105
BibTeX
@article{Fan2025,
author = {Fan, Liangwei and Yang, Jingjun and Wang, Lei and Zhang, Jinpu and Lian, Xiangkai and Shen, Hui},
title = {Efficient Spiking Neural Network for RGB–Event Fusion-Based Object Detection},
journal = {Electronics},
year = {2025},
volume = {14},
number = {6},
pages = {1105},
doi = {10.3390/electronics14061105}
}
EUVIMED