EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Variable-Damping Impedance Control for Contact Tasks: A Reinforcement Learning Method Integrating HER and Importance Sampling

Xiaoqiang Guo, Hongchang Ding, Xin Ning, Han Hou iD, Jinhua Cai

Sensors · 17.07.2026 · 26 (14) · 4538

DOI: 10.3390/s26144538 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 17.07.2026. Verfasst von Xiaoqiang Guo und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechatronic Engineering, Changchun University of Science and Technology, Changchun 130022, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Equipment Development Department of the Central Military Commission, Equipment Development Department of the Central Military Commission of the People’s Republic of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Force control is crucial for robotic contact-rich tasks such as assembly, grinding, and polishing, directly affecting task accuracy, interaction stability, and safety. Yet in unstructured environments, environmental uncertainty, contact oscillations, and friction disturbances make high-performance contact control and reinforcement learning policy optimization difficult. To address this issue, this paper proposes a deep reinforcement learning-based variable-damping impedance control method that integrates parameterized Hindsight Experience Replay (TO-HER) and Importance Sampling (IS). Within the impedance control framework, a residual parameterized policy enables online damping adjustment, improving dynamic adaptability across contact phases. To overcome the training instability of conventional HER in contact-intensive tasks, a parameterized goal relabeling mechanism is introduced to improve relabeled sample quality and sample efficiency. In addition, an importance sampling scheme based on density ratio estimation mitigates the distribution mismatch between relabeled and real samples, enhancing training quality and stability. Experimental results show that the proposed method outperforms baseline methods in convergence, final return, and training stability, while achieving higher tracking accuracy and better dynamic response in typical contact scenarios, demonstrating strong effectiveness and robustness for robotic contact control in unstructured environments.

Schlagwörter

Stichwörter der Autor:innen

contact force trackingdeep reinforcement learningimpedance controlindustrial robot

Autor:innen und Institutionen

  • School of Mechatronic Engineering, Changchun University of Science and Technology, Changchun 130022, China.
  • Chongqing Research Institute, Changchun University of Science and Technology, Chongqing 401133, China.

ORCID-Profile: Han Hou

Förderung

  • Equipment Development Department of the Central Military Commission
  • Equipment Development Department of the Central Military Commission of the People’s Republic of China

Zitieren

APA

Guo, X., Ding, H., Ning, X., Hou, H., & Cai, J. (2026). Variable-Damping Impedance Control for Contact Tasks: A Reinforcement Learning Method Integrating HER and Importance Sampling. Sensors, 26(14), 4538. https://doi.org/10.3390/s26144538

Vancouver

Guo X, Ding H, Ning X, Hou H, Cai J. Variable-Damping Impedance Control for Contact Tasks: A Reinforcement Learning Method Integrating HER and Importance Sampling. Sensors. 2026;26(14):4538. doi:10.3390/s26144538

BibTeX
@article{Guo2026,
  author = {Guo, Xiaoqiang and Ding, Hongchang and Ning, Xin and Hou, Han and Cai, Jinhua},
  title = {Variable-Damping Impedance Control for Contact Tasks: A Reinforcement Learning Method Integrating HER and Importance Sampling},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {14},
  pages = {4538},
  doi = {10.3390/s26144538}
}
Kostenlos starten →