UrbanNav: Learning Language-Guided Embodied Urban Navigation from Web-Scale Human Trajectories
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (22) · 18505-18513
DOI: 10.1609/aaai.v40i22.38916 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Yanghong Mei und 7 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref).
Abstract (Originalsprache)
Navigating complex urban environments using natural language instructions poses significant challenges for embodied agents, including noisy language instructions, ambiguous spatial references, diverse landmarks, and dynamic street scenes. Current visual navigation methods are typically limited to simulated or off-street environments, and often rely on precise goal formats, such as specific coordinates or images. This limits their effectiveness for autonomous agents like last-mile delivery robots navigating unfamiliar cities. To address these limitations, we introduce UrbanNav, a scalable framework that trains embodied agents to follow free-form language instructions in diverse urban settings. Leveraging web-scale city walking videos, we develop an scalable annotation pipeline that aligns human navigation trajectories with language instructions grounded in real-world landmarks. UrbanNav encompasses over 1,500 hours of navigation data and 3 million instruction-trajectory-landmark triplets, capturing a wide range of urban scenarios. Our model learns robust navigation policies to tackle complex urban scenarios, demonstrating superior spatial reasoning, robustness to noisy instructions, and generalization to unseen urban settings. Experimental results show that UrbanNav significantly outperforms existing methods, highlighting the potential of large-scale web video data to enable language-guided, real-world urban navigation for embodied agents.
Zitieren
APA
Mei, Y., Yang, Y., Guo, L., Wang, Q., Yu, M., He, X., Wu, W., & Liu, J. (2026). UrbanNav: Learning Language-Guided Embodied Urban Navigation from Web-Scale Human Trajectories. Proceedings of the AAAI Conference on Artificial Intelligence, 40(22), 18505-18513. https://doi.org/10.1609/aaai.v40i22.38916
Vancouver
Mei Y, Yang Y, Guo L, Wang Q, Yu M, He X, et al. UrbanNav: Learning Language-Guided Embodied Urban Navigation from Web-Scale Human Trajectories. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(22):18505-18513. doi:10.1609/aaai.v40i22.38916
BibTeX
@article{Mei2026,
author = {Mei, Yanghong and Yang, Yirong and Guo, Longteng and Wang, Qunbo and Yu, Ming-Ming and He, Xingjian and Wu, Wenjun and Liu, Jing},
title = {UrbanNav: Learning Language-Guided Embodied Urban Navigation from Web-Scale Human Trajectories},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {22},
pages = {18505--18513},
doi = {10.1609/aaai.v40i22.38916}
}
EUVIMED