EUVIMEDEUVIMED entdecken
Crossref

GraphCoT-VLA: A 3D Spatial-Aware Reasoning Vision-Language-Action Model for Robotic Manipulation with Ambiguous Instructions

Helong Huang, Min Cen, Kai Tan, Xingyue Quan, Guowei Huang, Hong Zhang

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (22) · 18324-18332

DOI: 10.1609/aaai.v40i22.38896 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Helong Huang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Vision-language-action models have emerged as a crucial paradigm in robotic manipulation. However, existing VLA models exhibit notable limitations in handling ambiguous language instructions and unknown environmental states. Furthermore, their perception is largely constrained to static two-dimensional observations, lacking the capability to model three-dimensional interactions between the robot and its environment. To address these challenges, this paper proposes GraphCoT-VLA, an efficient end-to-end model. To enhance the model's ability to interpret ambiguous instructions and improve task planning, we design a structured Chain-of-Thought reasoning module that integrates high-level task understanding and planning, failed task feedback, and low-level imaginative reasoning about future object positions and robot actions. Additionally, we construct a real-time updatable 3D Pose-Object graph, which captures the spatial configuration of robot joints and the topological relationships between objects in 3D space, enabling the model to better understand and manipulate their interactions. We further integrates a dropout hybrid reasoning strategy to achieve efficient control outputs. Experimental results across multiple real-world robotic tasks demonstrate that GraphCoT-VLA significantly outperforms existing methods in terms of task success rate and response speed, exhibiting strong generalization and robustness in open environments and under uncertain instructions.

Zitieren

APA

Huang, H., Cen, M., Tan, K., Quan, X., Huang, G., & Zhang, H. (2026). GraphCoT-VLA: A 3D Spatial-Aware Reasoning Vision-Language-Action Model for Robotic Manipulation with Ambiguous Instructions. Proceedings of the AAAI Conference on Artificial Intelligence, 40(22), 18324-18332. https://doi.org/10.1609/aaai.v40i22.38896

Vancouver

Huang H, Cen M, Tan K, Quan X, Huang G, Zhang H. GraphCoT-VLA: A 3D Spatial-Aware Reasoning Vision-Language-Action Model for Robotic Manipulation with Ambiguous Instructions. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(22):18324-18332. doi:10.1609/aaai.v40i22.38896

BibTeX
@article{Huang2026,
  author = {Huang, Helong and Cen, Min and Tan, Kai and Quan, Xingyue and Huang, Guowei and Zhang, Hong},
  title = {GraphCoT-VLA: A 3D Spatial-Aware Reasoning Vision-Language-Action Model for Robotic Manipulation with Ambiguous Instructions},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {22},
  pages = {18324--18332},
  doi = {10.1609/aaai.v40i22.38896}
}
Kostenlos starten →