Red green blue-depth multimodal learning for vision-guided grasping in Delta robots
Robotica · 2026-01 · 44 (1) · 252-274
DOI: 10.1017/s0263574726103154 ↗Kurz gefasst
Fachartikel in der Zeitschrift Robotica, online erschienen am 13.02.2026. Verfasst von Puxuan Ning und 5 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 30 Literaturangaben.
Abstract (Originalsprache)
In unstructured environments, Delta robots face challenges in achieving high vision-guided grasping precision due to dynamic lighting conditions and workpiece diversity. This paper designs an integrated solution that combines RGB-D multimodal learning with an enhanced Mask R-CNN framework. Initially, a dual-stream ResNet50-FPN backbone network is designed to achieve cross-modal adaptive alignment via hierarchical feature fusion. Subsequently, a depth-guided attention module is incorporated to bolster robustness against material ambiguity and reflective interference. Moreover, a dynamic depth estimation algorithm is employed to significantly improve target localization accuracy and stability. Finally, real-time trajectory tracking is realized by integrating PD control with Jacobian mapping. Experimental results validate the efficacy of the proposed method, offering an efficient and reliable approach for industrial robotic applications.
Zitieren
APA
Ning, P., Mei, J., Ni, J., Liu, P., Wei, T., & Su, X. (2026). Red green blue-depth multimodal learning for vision-guided grasping in Delta robots. Robotica, 44(1), 252-274. https://doi.org/10.1017/s0263574726103154
Vancouver
Ning P, Mei J, Ni J, Liu P, Wei T, Su X. Red green blue-depth multimodal learning for vision-guided grasping in Delta robots. Robotica. 2026;44(1):252-274. doi:10.1017/s0263574726103154
BibTeX
@article{Ning2026,
author = {Ning, Puxuan and Mei, Jiangping and Ni, Jinlu and Liu, Peichen and Wei, Tianlin and Su, Xiaochen},
title = {Red green blue-depth multimodal learning for vision-guided grasping in Delta robots},
journal = {Robotica},
year = {2026},
volume = {44},
number = {1},
pages = {252--274},
doi = {10.1017/s0263574726103154}
}
EUVIMED