EUVIMEDEUVIMED entdecken
Crossref

Cross-Modal Semidense 6-DOF Tracking of an Event Camera in Challenging Conditions

Yi-Fan Zuo, Wanting Xu, Xia Wang, Yifu Wang, Laurent Kneip

IEEE Transactions on Robotics · 2024 · 40 · 1600-1616

DOI: 10.1109/tro.2024.3355370 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Robotics, 2024. Verfasst von Yi-Fan Zuo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 63 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Shanghai.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Vision-based localization is a cost-effective and, thus, attractive solution for many intelligent mobile platforms. However, its accuracy and especially robustness still suffer from low illumination conditions, illumination changes, and aggressive motion. Event-based cameras are bio-inspired visual sensors that perform well in high dynamic range conditions and have high-temporal resolution, and thus, provide an interesting alternative in such challenging scenarios. While purely event-based solutions currently do not yet produce satisfying mapping results, the present work demonstrates the feasibility of purely event-based tracking if an alternative sensor is permitted for mapping. The method relies on geometric 3-D–2-D registration of semidense maps and events, and achieves highly reliable and accurate cross-modal tracking results. Practically relevant scenarios are given by depth camera-supported tracking or map-based localization with a semidense map prior created by a regular image-based visual SLAM or structure-from-motion system. Conventional edge-based 3-D–2-D alignment is extended by a novel polarity-aware registration that makes use of signed time-surface maps obtained from event streams. We, furthermore, introduce a novel culling strategy for occluded points. Both modifications increase the speed of the tracker and its robustness against occlusions or large view-point variations. The approach is validated on many real datasets covering the abovementioned challenging conditions, and compared against similar solutions realized with regular cameras.

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of Shanghai

Zitieren

APA

Zuo, Y., Xu, W., Wang, X., Wang, Y., & Kneip, L. (2024). Cross-Modal Semidense 6-DOF Tracking of an Event Camera in Challenging Conditions. IEEE Transactions on Robotics, 40, 1600-1616. https://doi.org/10.1109/tro.2024.3355370

Vancouver

Zuo Y, Xu W, Wang X, Wang Y, Kneip L. Cross-Modal Semidense 6-DOF Tracking of an Event Camera in Challenging Conditions. IEEE Transactions on Robotics. 2024;40:1600-1616. doi:10.1109/tro.2024.3355370

BibTeX
@article{Zuo2024,
  author = {Zuo, Yi-Fan and Xu, Wanting and Wang, Xia and Wang, Yifu and Kneip, Laurent},
  title = {Cross-Modal Semidense 6-DOF Tracking of an Event Camera in Challenging Conditions},
  journal = {IEEE Transactions on Robotics},
  year = {2024},
  volume = {40},
  pages = {1600--1616},
  doi = {10.1109/tro.2024.3355370}
}
Kostenlos starten →