EUVIMEDEUVIMED entdecken
Crossref

Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments

Kehan Chen, Dong An, Yan Huang, Rongtao Xu, Yifei Su, Yonggen Ling, Ian Reid, Liang Wang

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-11 · 47 (11) · 10441-10456

DOI: 10.1109/tpami.2025.3594204 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-11. Verfasst von Kehan Chen und 7 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 85 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Youth Innovation Promotion Association of the Chinese Academy of Sciences, FiveAges Grant.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We address the task of Vision-Language Navigation in Continuous Environments (VLN-CE) under the zero-shot setting. Zero-shot VLN-CE is particularly challenging due to the absence of expert demonstrations for training and minimal environment structural prior to guide navigation. To confront these challenges, we propose a Constraint-Aware Navigator (CA-Nav), which reframes zero-shot VLN-CE as a sequential, constraint-aware sub-instruction completion process. CA-Nav continuously translates sub-instructions into navigation plans using two core modules: the Constraint-Aware Sub-instruction Manager (CSM) and the Constraint-Aware Value Mapper (CVM). CSM defines the completion criteria for decomposed sub-instructions as constraints and tracks navigation progress by switching sub-instructions in a constraint-aware manner. CVM, guided by CSM's constraints, generates a value map on the fly and refines it using superpixel clustering to improve navigation stability. CA-Nav achieves the state-of-the-art performance on two VLN-CE benchmarks, surpassing the previous best method by 12% and 13% in Success Rate on the validation unseen splits of R2R-CE and RxR-CE, respectively. Moreover, CA-Nav demonstrates its effectiveness in real-world robot deployments across various indoor scenes and instructions.

Förderung

  • National Natural Science Foundation of China
  • Youth Innovation Promotion Association of the Chinese Academy of Sciences
  • FiveAges Grant

Zitieren

APA

Chen, K., An, D., Huang, Y., Xu, R., Su, Y., Ling, Y., Reid, I., & Wang, L. (2025). Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(11), 10441-10456. https://doi.org/10.1109/tpami.2025.3594204

Vancouver

Chen K, An D, Huang Y, Xu R, Su Y, Ling Y, et al. Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(11):10441-10456. doi:10.1109/tpami.2025.3594204

BibTeX
@article{Chen2025,
  author = {Chen, Kehan and An, Dong and Huang, Yan and Xu, Rongtao and Su, Yifei and Ling, Yonggen and Reid, Ian and Wang, Liang},
  title = {Constraint-Aware Zero-Shot Vision-Language Navigation in Continuous Environments},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2025},
  volume = {47},
  number = {11},
  pages = {10441--10456},
  doi = {10.1109/tpami.2025.3594204}
}
Kostenlos starten →