EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Efficient Spiking Neural Network for RGB–Event Fusion-Based Object Detection

Liangwei Fan, Jingjun Yang, Lei Wang, Jinpu Zhang, Xiangkai Lian, Hui Shen

Electronics · 11.03.2025 · 14 (6) · 1105

DOI: 10.3390/electronics14061105 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 11.03.2025. Verfasst von Liangwei Fan und 5 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Robust object detection in challenging scenarios remains a critical challenge for autonomous driving systems. Inspired by human visual perception, integrating the complementary modalities of RGB frames and event streams presents a promising approach to achieving robust object detection. However, existing multimodal object detectors achieve superior performance at the cost of significant computational power consumption. To address this challenge, we propose a novel spiking RGB–event fusion-based detection network (SFDNet), a fully spiking object detector capable of achieving both low-power and high-performance object detection. Specifically, we first introduce the Leaky Integrate-and-Multi-Fire (LIMF) neuron model, which combines soft and hard reset mechanisms to enhance feature representation in SNNs. We then develop a multi-scale hierarchical spiking residual attention network and a lightweight spiking aggregation module for efficient dual-modality feature extraction and fusion. Experimental results on two public multimodal object detection datasets demonstrate that our SFDNet achieves state-of-the-art performance with remarkably low power consumption. The superior performance in challenging scenarios, such as motion blur and low-light conditions, highlights the robustness and effectiveness of SFDNet, significantly advancing the applicability of SNNs for real-world object detection tasks.

Zitieren

APA

Fan, L., Yang, J., Wang, L., Zhang, J., Lian, X., & Shen, H. (2025). Efficient Spiking Neural Network for RGB–Event Fusion-Based Object Detection. Electronics, 14(6), 1105. https://doi.org/10.3390/electronics14061105

Vancouver

Fan L, Yang J, Wang L, Zhang J, Lian X, Shen H. Efficient Spiking Neural Network for RGB–Event Fusion-Based Object Detection. Electronics. 2025;14(6):1105. doi:10.3390/electronics14061105

BibTeX
@article{Fan2025,
  author = {Fan, Liangwei and Yang, Jingjun and Wang, Lei and Zhang, Jinpu and Lian, Xiangkai and Shen, Hui},
  title = {Efficient Spiking Neural Network for RGB–Event Fusion-Based Object Detection},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {6},
  pages = {1105},
  doi = {10.3390/electronics14061105}
}
Kostenlos starten →