GaussNav: Gaussian Splatting for Visual Navigation
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-05 · 47 (5) · 4108-4121
DOI: 10.1109/tpami.2025.3538496 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-05. Verfasst von Xiaohan Lei und 3 weiteren Autor:innen. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 84 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Laboratory of Target Cognition and Application Technology, Youth Innovation Promotion Association of the Chinese Academy of Sciences.
Abstract (Originalsprache)
In embodied vision, Instance ImageGoal Navigation (IIN) requires an agent to locate a specific object depicted in a goal image within an unexplored environment. The primary challenge of IIN arises from the need to recognize the target object across varying viewpoints while ignoring potential distractors. Existing map-based navigation methods typically use Bird's Eye View (BEV) maps, which lack detailed texture representation of a scene. Consequently, while BEV maps are effective for semantic-level visual navigation, they are struggling for instance-level tasks. To this end, we propose a new framework for IIN, Gaussian Splatting for Visual Navigation (GaussNav), which constructs a novel map representation based on 3D Gaussian Splatting (3DGS). The GaussNav framework enables the agent to memorize both the geometry and semantic information of the scene, as well as retain the textural features of objects. By matching renderings of similar objects with the target, the agent can accurately identify, ground, and navigate to the specified object. Our GaussNav framework demonstrates a significant performance improvement, with Success weighted by Path Length (SPL) increasing from 0.347 to 0.578 on the challenging Habitat-Matterport 3D (HM3D) dataset.
Förderung
- National Natural Science Foundation of China
- Key Laboratory of Target Cognition and Application Technology
- Youth Innovation Promotion Association of the Chinese Academy of Sciences
- GPU cluster built by MCC Lab of Information Science and Technology Institution
- University of Science and Technology of China
- Supercomputing Center of the USTC
Zitieren
APA
Lei, X., Wang, M., Zhou, W., & Li, H. (2025). GaussNav: Gaussian Splatting for Visual Navigation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(5), 4108-4121. https://doi.org/10.1109/tpami.2025.3538496
Vancouver
Lei X, Wang M, Zhou W, Li H. GaussNav: Gaussian Splatting for Visual Navigation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(5):4108-4121. doi:10.1109/tpami.2025.3538496
BibTeX
@article{Lei2025,
author = {Lei, Xiaohan and Wang, Min and Zhou, Wengang and Li, Houqiang},
title = {GaussNav: Gaussian Splatting for Visual Navigation},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {47},
number = {5},
pages = {4108--4121},
doi = {10.1109/tpami.2025.3538496}
}
EUVIMED