EUVIMEDEUVIMED entdecken
Crossref

Key Technologies for Robot Autonomous Manipulation Based on Vision-Control Fusion

Xiaoyu Xiong

Ingegneria Sismica · 10.06.2026 · 42 (4) · 1-18

DOI: 10.65102/is20261235 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Ingegneria Sismica, online erschienen am 10.06.2026. Verfasst von Xiaoyu Xiong.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In unstructured environments, autonomous robot manipulation suffers from high visual perception uncertainty, large control delays, and shallow vision-control fusion, resulting in low success rates and poor trajectory accuracy under disturbances. Existing visual servoing, Diffusion Policy, and vision-language-action (VLA) models mostly employ one-way or static fusion, lacking real-time bidirectional interaction. This study proposes a Bidirectional Vision-Control Fusion Framework (BVCFF). An Uncertainty-Aware Adaptive Fusion mechanism (UAAF) dynamically balances vision and control weights via visual entropy and Lyapunov gradients. A Graph Attention Temporal Fusion network (GAT-TF) captures multimodal long-term dependencies. An end-to-end differentiable joint optimization embeds Lyapunov stability into the composite loss for bidirectional error back-propagation. Gazebo simulation experiments and preliminary real-robot validation on a UR5e platform show superior performance: 94.8% grasping success, 87.6% insertion success, 80.3% dynamic success (simulation) and 87.2%, 76.4%, 68.7% (real-robot), 5.3 mm trajectory error, 43 FPS, and 0.92 robustness, outperforming seven benchmarks including Diffusion Policy and OpenVLA-inspired VLA. The deep bidirectional fusion provides an efficient, robust solution for embodied intelligence deployment.

Zitieren

APA

Xiong, X. (2026). Key Technologies for Robot Autonomous Manipulation Based on Vision-Control Fusion. Ingegneria Sismica, 42(4), 1-18. https://doi.org/10.65102/is20261235

Vancouver

Xiong X. Key Technologies for Robot Autonomous Manipulation Based on Vision-Control Fusion. Ingegneria Sismica. 2026;42(4):1-18. doi:10.65102/is20261235

BibTeX
@article{Xiong2026,
  author = {Xiong, Xiaoyu},
  title = {Key Technologies for Robot Autonomous Manipulation Based on Vision-Control Fusion},
  journal = {Ingegneria Sismica},
  year = {2026},
  volume = {42},
  number = {4},
  pages = {1--18},
  doi = {10.65102/is20261235}
}
Kostenlos starten →