EUVIMEDEUVIMED entdecken
Crossref

Planning from Imagination: Episodic Simulation and Episodic Memory for Vision-and-Language Navigation

Yiyuan Pan, Yunzhe Xu, Zhe Liu, Hesheng Wang

Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (6) · 6345-6353

DOI: 10.1609/aaai.v39i6.32679 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Yiyuan Pan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Humans navigate unfamiliar environments using episodic simulation and episodic memory, which facilitate a deeper understanding of the complex relationships between environments and objects. Developing an imaginative memory system inspired by human mechanisms can enhance the navigation performance of embodied agents in unseen environments. However, existing Vision-and-Language Navigation (VLN) agents lack a memory mechanism of this kind. To address this, we propose a novel architecture that equips agents with a reality-imagination hybrid memory system. This system enables agents to maintain and expand their memory through both imaginative mechanisms and navigation actions. Additionally, we design tailored pre-training tasks to develop the agent's imaginative capabilities. Our agent can imagine high-fidelity RGB images for future scenes, achieving state-of-the-art results in a Success rate weighted by Path Length (SPL).

Zitieren

APA

Pan, Y., Xu, Y., Liu, Z., & Wang, H. (2025). Planning from Imagination: Episodic Simulation and Episodic Memory for Vision-and-Language Navigation. Proceedings of the AAAI Conference on Artificial Intelligence, 39(6), 6345-6353. https://doi.org/10.1609/aaai.v39i6.32679

Vancouver

Pan Y, Xu Y, Liu Z, Wang H. Planning from Imagination: Episodic Simulation and Episodic Memory for Vision-and-Language Navigation. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(6):6345-6353. doi:10.1609/aaai.v39i6.32679

BibTeX
@article{Pan2025,
  author = {Pan, Yiyuan and Xu, Yunzhe and Liu, Zhe and Wang, Hesheng},
  title = {Planning from Imagination: Episodic Simulation and Episodic Memory for Vision-and-Language Navigation},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2025},
  volume = {39},
  number = {6},
  pages = {6345--6353},
  doi = {10.1609/aaai.v39i6.32679}
}
Kostenlos starten →