A Dual-Modal Robot Welding Trajectory Generation Scheme for Motion Based on Stereo Vision and Deep Learning
Materials · 01.06.2025 · 18 (11) · 2593
DOI: 10.3390/ma18112593 ↗Kurz gefasst
Fachartikel in der Zeitschrift Materials, online erschienen am 01.06.2025. Verfasst von Xinlei Li und 4 weiteren Autor:innen. Beteiligte Einrichtung: State Key Laboratory of Precision Welding & Joining of Materials and Structures, Harbin Institute of Technology, Harbin 150001, China. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the National Key R&D Program, the Heilongjiang Postdoctoral Funded Project, the State Key Laboratory of Advanced Welding and Joining Independent Funded Project.
Abstract (Originalsprache)
To address the challenges of redundant point cloud processing and insufficient robustness under complex working conditions in existing teaching-free methods, this study proposes a dual-modal perception framework termed “2D image autonomous recognition and 3D point cloud precise planning”, which integrates stereo vision and deep learning. First, an improved U-Net deep learning model is developed, where VGG16 serves as the backbone network and a dual-channel attention module (DAM) is incorporated, achieving robust weld segmentation with a mean intersection over union (mIoU) of 0.887 and an F1-Score of 0.940. Next, the weld centerline is extracted using the Zhang–Suen skeleton refinement algorithm, and weld feature points are obtained through polynomial fitting optimization to establish cross-modal mapping between 2D pixels and 3D point clouds. Finally, a groove feature point extraction algorithm based on improved RANSAC combined with an equal-area weld bead filling strategy is designed to enable multi-layer and multi-bead robot trajectory planning, achieving a mean absolute error (MAE) of 0.238 mm in feature point positioning. Experimental results demonstrate that the method maintains high accuracy under complex working conditions such as noise interference and groove deformation, achieving a system accuracy of 0.208 mm and weld width fluctuation within ±0.15 mm, thereby significantly improving the autonomy and robustness of robot trajectory planning.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- State Key Laboratory of Precision Welding & Joining of Materials and Structures, Harbin Institute of Technology, Harbin 150001, China.
- School of Mechanical and Electrical Engineering, Harbin Institute of Technology, Harbin 150001, China.
Förderung
- the National Key R&D Program
- the Heilongjiang Postdoctoral Funded Project
- the State Key Laboratory of Advanced Welding and Joining Independent Funded Project
- the National Key R&D Program
- Heilongjiang Postdoctoral Funded Project
- State Key Laboratory of Advanced Welding and Joining Independent Funded Project
Zitieren
APA
Li, X., Ma, J., Yao, S., Chi, G., & Zhang, G. (2025). A Dual-Modal Robot Welding Trajectory Generation Scheme for Motion Based on Stereo Vision and Deep Learning. Materials, 18(11), 2593. https://doi.org/10.3390/ma18112593
Vancouver
Li X, Ma J, Yao S, Chi G, Zhang G. A Dual-Modal Robot Welding Trajectory Generation Scheme for Motion Based on Stereo Vision and Deep Learning. Materials. 2025;18(11):2593. doi:10.3390/ma18112593
BibTeX
@article{Li2025,
author = {Li, Xinlei and Ma, Jiawei and Yao, Shida and Chi, Guanxin and Zhang, Guangjun},
title = {A Dual-Modal Robot Welding Trajectory Generation Scheme for Motion Based on Stereo Vision and Deep Learning},
journal = {Materials},
year = {2025},
volume = {18},
number = {11},
pages = {2593},
doi = {10.3390/ma18112593}
}
EUVIMED