EUVIMEDEUVIMED entdecken
Crossref

Dual Memory Aggregation Network for Event-Based Object Detection with Learnable Representation

Dongsheng Wang, Xu Jia, Yang Zhang, Xinyu Zhang, Yaoyuan Wang, Ziyang Zhang, Dong Wang, Huchuan Lu

Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (2) · 2492-2500

DOI: 10.1609/aaai.v37i2.25346 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Dongsheng Wang und 7 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Event-based cameras are bio-inspired sensors that capture brightness change of every pixel in an asynchronous manner. Compared with frame-based sensors, event cameras have microsecond-level latency and high dynamic range, hence showing great potential for object detection under high-speed motion and poor illumination conditions. Due to sparsity and asynchronism nature with event streams, most of existing approaches resort to hand-crafted methods to convert event data into 2D grid representation. However, they are sub-optimal in aggregating information from event stream for object detection. In this work, we propose to learn an event representation optimized for event-based object detection. Specifically, event streams are divided into grids in the x-y-t coordinates for both positive and negative polarity, producing a set of pillars as 3D tensor representation. To fully exploit information with event streams to detect objects, a dual-memory aggregation network (DMANet) is proposed to leverage both long and short memory along event streams to aggregate effective information for object detection. Long memory is encoded in the hidden state of adaptive convLSTMs while short memory is modeled by computing spatial-temporal correlation between event pillars at neighboring time intervals. Extensive experiments on the recently released event-based automotive detection dataset demonstrate the effectiveness of the proposed method.

Zitieren

APA

Wang, D., Jia, X., Zhang, Y., Zhang, X., Wang, Y., Zhang, Z., Wang, D., & Lu, H. (2023). Dual Memory Aggregation Network for Event-Based Object Detection with Learnable Representation. Proceedings of the AAAI Conference on Artificial Intelligence, 37(2), 2492-2500. https://doi.org/10.1609/aaai.v37i2.25346

Vancouver

Wang D, Jia X, Zhang Y, Zhang X, Wang Y, Zhang Z, et al. Dual Memory Aggregation Network for Event-Based Object Detection with Learnable Representation. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(2):2492-2500. doi:10.1609/aaai.v37i2.25346

BibTeX
@article{Wang2023,
  author = {Wang, Dongsheng and Jia, Xu and Zhang, Yang and Zhang, Xinyu and Wang, Yaoyuan and Zhang, Ziyang and Wang, Dong and Lu, Huchuan},
  title = {Dual Memory Aggregation Network for Event-Based Object Detection with Learnable Representation},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2023},
  volume = {37},
  number = {2},
  pages = {2492--2500},
  doi = {10.1609/aaai.v37i2.25346}
}
Kostenlos starten →