Toward Deep Representation Learning for Event-Enhanced Visual Autonomous Perception: The eAP Dataset
IEEE Transactions on Robotics · 2026 · 42 · 1643-1661
DOI: 10.1109/tro.2026.3677912 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Robotics, 2026. Verfasst von Jinghang Li und 5 weiteren Autor:innen. Die Arbeit nennt 71 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Project of China.
Abstract (Originalsprache)
Recent visual autonomous perception systems achieve remarkable performances with deep representation learning. However, they fail in scenarios with challenging illumination. While event cameras can mitigate this problem, there is a lack of a large-scale dataset to develop event-enhanced deep visual perception models in autonomous driving scenes. To address the gap, we present the event-enhanced autonomous perception (eAP) dataset, the largest dataset with event cameras for autonomous perception. We demonstrate how eAP can facilitate the study of different autonomous perception tasks, including 3-D vehicle detection and object time-to-contact (TTC) estimation, through deep representation learning. Based on eAP, we demonstrate the first successful use of events to improve a popular 3-D vehicle detection network in challenging illumination scenarios. eAP also enables a devoted study of the representation learning problem of object TTC estimation. We show how a geometry-aware representation learning framework leads to the best event-based object TTC estimation network that operates at 200 FPS. The dataset, code, and pretrained models will be made publicly available for future research.
Förderung
- National Natural Science Foundation of China
- National Key Research and Development Project of China
Zitieren
APA
Li, J., Li, S., Lian, Q., Li, P., Chen, X., & Zhou, Y. (2026). Toward Deep Representation Learning for Event-Enhanced Visual Autonomous Perception: The eAP Dataset. IEEE Transactions on Robotics, 42, 1643-1661. https://doi.org/10.1109/tro.2026.3677912
Vancouver
Li J, Li S, Lian Q, Li P, Chen X, Zhou Y. Toward Deep Representation Learning for Event-Enhanced Visual Autonomous Perception: The eAP Dataset. IEEE Transactions on Robotics. 2026;42:1643-1661. doi:10.1109/tro.2026.3677912
BibTeX
@article{Li2026,
author = {Li, Jinghang and Li, Shichao and Lian, Qing and Li, Peiliang and Chen, Xiaozhi and Zhou, Yi},
title = {Toward Deep Representation Learning for Event-Enhanced Visual Autonomous Perception: The eAP Dataset},
journal = {IEEE Transactions on Robotics},
year = {2026},
volume = {42},
pages = {1643--1661},
doi = {10.1109/tro.2026.3677912}
}
EUVIMED