EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Novel Cross-Attention-Based Pedestrian Visual–Inertial Odometry With Analyses Demonstrating Challenges in Dense Optical Flow

Ilari Pajula, Niclas Joswig, Aiden Morrison, Nadia Sokolova, Laura Ruotsalainen

IEEE Journal of Indoor and Seamless Positioning and Navigation · 2024 · 2 · 25-35

DOI: 10.1109/jispin.2023.3344077 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Journal of Indoor and Seamless Positioning and Navigation, 2024. Verfasst von Ilari Pajula und 4 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: North Atlantic Treaty Organization (NATO) Science for Peace and Security, Collaborative Augmented Navigation for Defence Objectives II, Matine, the Scientific Advisory Board for Defence in Finland.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visual–inertial odometry (VIO), the fusion of visual and inertial sensor data, has been shown to be functional for navigation in global-navigation-satellite-system-denied environments. Recently, dense-optical-flow-based end-to-end trained deep learning VIO models have gained superior performance in outdoor navigation. In this article, we introduced a novel visual–inertial sensor fusion approach based on vision transformer architecture with a cross-attention mechanism, specifically designed to better integrate potentially poor-quality optical flow features with inertial data. Although optical-flow-based VIO models have obtained superior performance in outdoor vehicle navigation, both in accuracy and ease of calibration, we have shown how their suitability for indoor pedestrian navigation is still far from existing feature-matching-based methods. We compare the performance of traditional VIO models against deep-learning-based VIO models on the KITTI benchmark dataset and our custom pedestrian navigation dataset. We show how end-to-end trained VIO models using optical flow were significantly outperformed by simpler visual odometry models utilizing feature matching. Our findings indicate that due to the robustness against occlusion and camera shake, feature matching is better suited for indoor pedestrian navigation, whereas dense optical flow remains viable for vehicular data. Therefore, the most feasible way forward will be the integration of our novel model with feature-based visual data encoding.

Förderung

  • North Atlantic Treaty Organization (NATO) Science for Peace and Security
  • Collaborative Augmented Navigation for Defence Objectives II
  • Matine, the Scientific Advisory Board for Defence in Finland

Zitieren

APA

Pajula, I., Joswig, N., Morrison, A., Sokolova, N., & Ruotsalainen, L. (2024). A Novel Cross-Attention-Based Pedestrian Visual–Inertial Odometry With Analyses Demonstrating Challenges in Dense Optical Flow. IEEE Journal of Indoor and Seamless Positioning and Navigation, 2, 25-35. https://doi.org/10.1109/jispin.2023.3344077

Vancouver

Pajula I, Joswig N, Morrison A, Sokolova N, Ruotsalainen L. A Novel Cross-Attention-Based Pedestrian Visual–Inertial Odometry With Analyses Demonstrating Challenges in Dense Optical Flow. IEEE Journal of Indoor and Seamless Positioning and Navigation. 2024;2:25-35. doi:10.1109/jispin.2023.3344077

BibTeX
@article{Pajula2024,
  author = {Pajula, Ilari and Joswig, Niclas and Morrison, Aiden and Sokolova, Nadia and Ruotsalainen, Laura},
  title = {A Novel Cross-Attention-Based Pedestrian Visual–Inertial Odometry With Analyses Demonstrating Challenges in Dense Optical Flow},
  journal = {IEEE Journal of Indoor and Seamless Positioning and Navigation},
  year = {2024},
  volume = {2},
  pages = {25--35},
  doi = {10.1109/jispin.2023.3344077}
}
Kostenlos starten →