EUVIMEDEUVIMED entdecken
Crossref

ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments

Dong An, Hanqing Wang, Wenguan Wang, Zun Wang, Yan Huang, Keji He, Liang Wang

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-07 · 47 (7) · 5130-5145

DOI: 10.1109/tpami.2024.3386695 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-07. Verfasst von Dong An und 6 weiteren Autor:innen. Die Arbeit wurde bisher 109-mal zitiert (Crossref) und nennt 95 Literaturangaben. Gefördert von: National Key R&D Program of China, National Natural Science Foundation of China, CCF-Tencent Open Fund.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Vision-language navigation is a task that requires an agent to follow instructions to navigate in environments. It becomes increasingly crucial in the field of embodied AI, with potential applications in autonomous navigation, search and rescue, and human-robot interaction. In this paper, we propose to address a more practical yet challenging counterpart setting - vision-language navigation in continuous environments (VLN-CE). To develop a robust VLN-CE agent, we propose a new navigation framework, ETPNav, which focuses on two critical skills: 1) the capability to abstract environments and generate long-range navigation plans, and 2) the ability of obstacle-avoiding control in continuous environments. ETPNav performs online topological mapping of environments by self-organizing predicted waypoints along a traversed path, without prior environmental experience. It privileges the agent to break down the navigation procedure into high-level planning and low-level control. Concurrently, ETPNav utilizes a transformer-based cross-modal planner to generate navigation plans based on topological maps and instructions. The plan is then performed through an obstacle-avoiding controller that leverages a trial-and-error heuristic to prevent navigation from getting stuck in obstacles. Experimental results demonstrate the effectiveness of the proposed method. ETPNav yields more than 10% and 20% improvements over prior state-of-the-art on R2R-CE and RxR-CE datasets, respectively.

Förderung

  • National Key R&D Program of China
  • National Natural Science Foundation of China
  • CCF-Tencent Open Fund

Zitieren

APA

An, D., Wang, H., Wang, W., Wang, Z., Huang, Y., He, K., & Wang, L. (2025). ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(7), 5130-5145. https://doi.org/10.1109/tpami.2024.3386695

Vancouver

An D, Wang H, Wang W, Wang Z, Huang Y, He K, et al. ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(7):5130-5145. doi:10.1109/tpami.2024.3386695

BibTeX
@article{An2025,
  author = {An, Dong and Wang, Hanqing and Wang, Wenguan and Wang, Zun and Huang, Yan and He, Keji and Wang, Liang},
  title = {ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2025},
  volume = {47},
  number = {7},
  pages = {5130--5145},
  doi = {10.1109/tpami.2024.3386695}
}
Kostenlos starten →