Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-11 · 47 (11) · 10441-10456
DOI: 10.1109/tpami.2025.3594204 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-11. Verfasst von Kehan Chen und 7 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 85 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Youth Innovation Promotion Association of the Chinese Academy of Sciences, FiveAges Grant.
Abstract (Originalsprache)
We address the task of Vision-Language Navigation in Continuous Environments (VLN-CE) under the zero-shot setting. Zero-shot VLN-CE is particularly challenging due to the absence of expert demonstrations for training and minimal environment structural prior to guide navigation. To confront these challenges, we propose a Constraint-Aware Navigator (CA-Nav), which reframes zero-shot VLN-CE as a sequential, constraint-aware sub-instruction completion process. CA-Nav continuously translates sub-instructions into navigation plans using two core modules: the Constraint-Aware Sub-instruction Manager (CSM) and the Constraint-Aware Value Mapper (CVM). CSM defines the completion criteria for decomposed sub-instructions as constraints and tracks navigation progress by switching sub-instructions in a constraint-aware manner. CVM, guided by CSM's constraints, generates a value map on the fly and refines it using superpixel clustering to improve navigation stability. CA-Nav achieves the state-of-the-art performance on two VLN-CE benchmarks, surpassing the previous best method by 12% and 13% in Success Rate on the validation unseen splits of R2R-CE and RxR-CE, respectively. Moreover, CA-Nav demonstrates its effectiveness in real-world robot deployments across various indoor scenes and instructions.
Förderung
- National Natural Science Foundation of China
- Youth Innovation Promotion Association of the Chinese Academy of Sciences
- FiveAges Grant
Zitieren
APA
Chen, K., An, D., Huang, Y., Xu, R., Su, Y., Ling, Y., Reid, I., & Wang, L. (2025). Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(11), 10441-10456. https://doi.org/10.1109/tpami.2025.3594204
Vancouver
Chen K, An D, Huang Y, Xu R, Su Y, Ling Y, et al. Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(11):10441-10456. doi:10.1109/tpami.2025.3594204
BibTeX
@article{Chen2025,
author = {Chen, Kehan and An, Dong and Huang, Yan and Xu, Rongtao and Su, Yifei and Ling, Yonggen and Reid, Ian and Wang, Liang},
title = {Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {47},
number = {11},
pages = {10441--10456},
doi = {10.1109/tpami.2025.3594204}
}
EUVIMED