EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

EVI‐SAM: Robust, Real‐Time, Tightly‐Coupled Event–Visual–Inertial State Estimation and 3D Dense Mapping

Weipeng Guan, Peiyu Chen, Huibin Zhao, Yu Wang, Peng Lu

Advanced Intelligent Systems · 2024-12 · 6 (12)

DOI: 10.1002/aisy.202400243 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Advanced Intelligent Systems, online erschienen am 05.07.2024. Verfasst von Weipeng Guan und 4 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 78 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Event cameras demonstrate substantial potential in handling challenging situations, such as motion blur and high dynamic range. Herein, event–visual–inertial state estimation and 3D dense mapping (EVI‐SAM) are introduced to tackle the problem of pose tracking and 3D dense reconstruction using the monocular event camera. A novel event‐based hybrid tracking framework is designed to estimate the pose, leveraging the robustness of feature matching and the precision of direct alignment. Specifically, an event‐based 2D–2D alignment is developed to construct the photometric constraint and tightly integrated with the event‐based reprojection constraint. The mapping module recovers the dense and colorful depth of the scene through the image‐guided event‐based mapping method. Subsequently, the appearance, texture, and surface mesh of the 3D scene can be reconstructed by fusing the dense depth map from multiple viewpoints using truncated signed distance function fusion. To the best of knowledge, this is the first nonlearning work to realize event‐based dense mapping. Numerical evaluations are performed on both publicly available datasets, which qualitatively and quantitatively demonstrate the superior performance of our method. EVI‐SAM effectively balances accuracy and robustness while maintaining computational efficiency, showcasing superior pose tracking and dense mapping performance in challenging scenarios.

Zitieren

APA

Guan, W., Chen, P., Zhao, H., Wang, Y., & Lu, P. (2024). EVI‐SAM: Robust, Real‐Time, Tightly‐Coupled Event–Visual–Inertial State Estimation and 3D Dense Mapping. Advanced Intelligent Systems, 6(12). https://doi.org/10.1002/aisy.202400243

Vancouver

Guan W, Chen P, Zhao H, Wang Y, Lu P. EVI‐SAM: Robust, Real‐Time, Tightly‐Coupled Event–Visual–Inertial State Estimation and 3D Dense Mapping. Advanced Intelligent Systems. 2024;6(12). doi:10.1002/aisy.202400243

BibTeX
@article{Guan2024,
  author = {Guan, Weipeng and Chen, Peiyu and Zhao, Huibin and Wang, Yu and Lu, Peng},
  title = {EVI‐SAM: Robust, Real‐Time, Tightly‐Coupled Event–Visual–Inertial State Estimation and 3D Dense Mapping},
  journal = {Advanced Intelligent Systems},
  year = {2024},
  volume = {6},
  number = {12},
  doi = {10.1002/aisy.202400243}
}
Kostenlos starten →