EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Collision Avoidance with Deep Learning in a Digital Twin for Industrial Collaborative Robot Manipulation

Tuan-Khanh Nguyen, The-Thinh Pham, Chi-Cuong Tran

Robotics · 06.08.2026 · 15 (8) · 150

DOI: 10.3390/robotics15080150 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Robotics, online erschienen am 06.08.2026. Verfasst von Tuan-Khanh Nguyen und 2 weiteren Autor:innen. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education and Training.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Safe human–robot collaboration remains a critical challenge in manufacturing. Traditional safety approaches, such as cages and proximity sensors, are often insufficient for dynamic human interaction. This paper presents a digital twin-based collision avoidance framework for industrial collaborative robot manipulation. The system integrates RGB-D sensing, human pose estimation using Ultralytics YOLO26s-pose, Kalman-filter-based 3D arm tracking, short-term motion prediction, and QP-based reactive motion control. Human arm keypoints detected from RGB-D images are reconstructed in 3D, transformed into the robot base frame, and tracked during temporary occlusion using Kalman filtering with kinematic constraints. Predicted human–robot clearance is evaluated to trigger speed reduction, stopping, or collision avoidance commands. The framework was implemented with a UR10e robot, an Intel RealSense D435 camera, a Unity3D digital twin, and ROS communication. Controlled laboratory experiments demonstrated the proof-of-concept feasibility of the integrated framework for tracking human arm motion, anticipating proximity risk, and triggering protective robot responses. The results do not establish deployment readiness in complex industrial or multi-participant environments.

Förderung

  • Ministry of Education and Training

Zitieren

APA

Nguyen, T., Pham, T., & Tran, C. (2026). Collision Avoidance with Deep Learning in a Digital Twin for Industrial Collaborative Robot Manipulation. Robotics, 15(8), 150. https://doi.org/10.3390/robotics15080150

Vancouver

Nguyen T, Pham T, Tran C. Collision Avoidance with Deep Learning in a Digital Twin for Industrial Collaborative Robot Manipulation. Robotics. 2026;15(8):150. doi:10.3390/robotics15080150

BibTeX
@article{Nguyen2026,
  author = {Nguyen, Tuan-Khanh and Pham, The-Thinh and Tran, Chi-Cuong},
  title = {Collision Avoidance with Deep Learning in a Digital Twin for Industrial Collaborative Robot Manipulation},
  journal = {Robotics},
  year = {2026},
  volume = {15},
  number = {8},
  pages = {150},
  doi = {10.3390/robotics15080150}
}
Kostenlos starten →