A Novel Cross-Attention-Based Pedestrian Visual–Inertial Odometry With Analyses Demonstrating Challenges in Dense Optical Flow
IEEE Journal of Indoor and Seamless Positioning and Navigation · 2024 · 2 · 25-35
DOI: 10.1109/jispin.2023.3344077 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Journal of Indoor and Seamless Positioning and Navigation, 2024. Verfasst von Ilari Pajula und 4 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: North Atlantic Treaty Organization (NATO) Science for Peace and Security, Collaborative Augmented Navigation for Defence Objectives II, Matine, the Scientific Advisory Board for Defence in Finland.
Abstract (Originalsprache)
Visual–inertial odometry (VIO), the fusion of visual and inertial sensor data, has been shown to be functional for navigation in global-navigation-satellite-system-denied environments. Recently, dense-optical-flow-based end-to-end trained deep learning VIO models have gained superior performance in outdoor navigation. In this article, we introduced a novel visual–inertial sensor fusion approach based on vision transformer architecture with a cross-attention mechanism, specifically designed to better integrate potentially poor-quality optical flow features with inertial data. Although optical-flow-based VIO models have obtained superior performance in outdoor vehicle navigation, both in accuracy and ease of calibration, we have shown how their suitability for indoor pedestrian navigation is still far from existing feature-matching-based methods. We compare the performance of traditional VIO models against deep-learning-based VIO models on the KITTI benchmark dataset and our custom pedestrian navigation dataset. We show how end-to-end trained VIO models using optical flow were significantly outperformed by simpler visual odometry models utilizing feature matching. Our findings indicate that due to the robustness against occlusion and camera shake, feature matching is better suited for indoor pedestrian navigation, whereas dense optical flow remains viable for vehicular data. Therefore, the most feasible way forward will be the integration of our novel model with feature-based visual data encoding.
Förderung
- North Atlantic Treaty Organization (NATO) Science for Peace and Security
- Collaborative Augmented Navigation for Defence Objectives II
- Matine, the Scientific Advisory Board for Defence in Finland
Zitieren
APA
Pajula, I., Joswig, N., Morrison, A., Sokolova, N., & Ruotsalainen, L. (2024). A Novel Cross-Attention-Based Pedestrian Visual–Inertial Odometry With Analyses Demonstrating Challenges in Dense Optical Flow. IEEE Journal of Indoor and Seamless Positioning and Navigation, 2, 25-35. https://doi.org/10.1109/jispin.2023.3344077
Vancouver
Pajula I, Joswig N, Morrison A, Sokolova N, Ruotsalainen L. A Novel Cross-Attention-Based Pedestrian Visual–Inertial Odometry With Analyses Demonstrating Challenges in Dense Optical Flow. IEEE Journal of Indoor and Seamless Positioning and Navigation. 2024;2:25-35. doi:10.1109/jispin.2023.3344077
BibTeX
@article{Pajula2024,
author = {Pajula, Ilari and Joswig, Niclas and Morrison, Aiden and Sokolova, Nadia and Ruotsalainen, Laura},
title = {A Novel Cross-Attention-Based Pedestrian Visual–Inertial Odometry With Analyses Demonstrating Challenges in Dense Optical Flow},
journal = {IEEE Journal of Indoor and Seamless Positioning and Navigation},
year = {2024},
volume = {2},
pages = {25--35},
doi = {10.1109/jispin.2023.3344077}
}
EUVIMED