A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation
IEEE Transactions on Automation Science and Engineering · 2026 · 23 · 14405-14434
DOI: 10.1109/tase.2026.3711284 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Automation Science and Engineering, 2026. Verfasst von Liuyi Wang und 10 weiteren Autor:innen. Die Arbeit nennt 281 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Navigation is a fundamental capability of autonomous systems, yet most existing approaches rely on highly structured models and strong prior assumptions, limiting their robustness in open and uncertain real-world environments. Vision-and-Language Navigation (VLN) offers a promising direction by enabling robots to integrate natural language understanding with visual perception in a data-driven manner. Although VLN has attracted increasing research attention, systematic methodological taxonomy and real-world validation remain limited. This survey presents a comprehensive review of VLN research. Specifically, state-of-the-art methods are organized along two orthogonal dimensions: action paradigms, including hierarchical and monolithic frameworks, and model paradigms, including discriminative and generative approaches. A critical analysis of their respective strengths and limitations is provided. Additionally, we conduct a systematic real-world evaluation of representative VLN system configurations on a physical robotic platform. Experiments across ten diverse real-world scenes show a substantial performance gap between simulation and real-world deployment under the tested configurations: a representative monolithic RGB-only method achieves 61% success in simulation but drops to 22% in real-world deployment, while a hierarchical framework achieves a higher real-world success rate of 51%, suggesting stronger robustness in our evaluation setting. Finally, we highlight key challenges in perception, decision-making, and control that must be addressed in future research. Note to Practitioners—For practitioners building mobile robots that navigate using natural language commands, this survey provides practical guidance on selecting, designing, and deploying VLN systems. Our empirical evaluations in real-world environments indicate that architectural choices have a substantial impact on both navigation performance and operational safety. At present, hierarchical navigation systems that combine panoramic visual perception with explicit 3D sensing and decompose navigation into high-level planning and low-level control achieve more reliable task success and lower collision frequencies. At the same time, several practical limitations remain. Current VLN systems often struggle to determine when to stop based on the semantic intent of an instruction rather than simple distance-based heuristics. They also show limited robustness when faced with ambiguous or underspecified instructions that commonly arise in complex human-robot interactions. Continued advances in intent understanding, safety-aware reasoning, and real-world learning are expected to gradually enable more flexible and robust deployment in less structured settings.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Wang, L., Sheng, K., He, Z., Li, J., Qin, Y., Dai, H., Wang, X., Yang, J., Yan, Q., Liu, C., & Chen, Q. (2026). A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation. IEEE Transactions on Automation Science and Engineering, 23, 14405-14434. https://doi.org/10.1109/tase.2026.3711284
Vancouver
Wang L, Sheng K, He Z, Li J, Qin Y, Dai H, et al. A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation. IEEE Transactions on Automation Science and Engineering. 2026;23:14405-14434. doi:10.1109/tase.2026.3711284
BibTeX
@article{Wang2026,
author = {Wang, Liuyi and Sheng, Kai and He, Zongtao and Li, Jinlong and Qin, Yongrui and Dai, Haojie and Wang, Xiangyi and Yang, Jingwei and Yan, Qingqing and Liu, Chengju and Chen, Qijun},
title = {A Comprehensive Survey and Systematic Real-World Evaluation of Embodied Vision-and-Language Navigation},
journal = {IEEE Transactions on Automation Science and Engineering},
year = {2026},
volume = {23},
pages = {14405--14434},
doi = {10.1109/tase.2026.3711284}
}
EUVIMED