Variable-Damping Impedance Control for Contact Tasks: A Reinforcement Learning Method Integrating HER and Importance Sampling
Sensors · 17.07.2026 · 26 (14) · 4538
DOI: 10.3390/s26144538 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 17.07.2026. Verfasst von Xiaoqiang Guo und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechatronic Engineering, Changchun University of Science and Technology, Changchun 130022, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Equipment Development Department of the Central Military Commission, Equipment Development Department of the Central Military Commission of the People’s Republic of China.
Abstract (Originalsprache)
Force control is crucial for robotic contact-rich tasks such as assembly, grinding, and polishing, directly affecting task accuracy, interaction stability, and safety. Yet in unstructured environments, environmental uncertainty, contact oscillations, and friction disturbances make high-performance contact control and reinforcement learning policy optimization difficult. To address this issue, this paper proposes a deep reinforcement learning-based variable-damping impedance control method that integrates parameterized Hindsight Experience Replay (TO-HER) and Importance Sampling (IS). Within the impedance control framework, a residual parameterized policy enables online damping adjustment, improving dynamic adaptability across contact phases. To overcome the training instability of conventional HER in contact-intensive tasks, a parameterized goal relabeling mechanism is introduced to improve relabeled sample quality and sample efficiency. In addition, an importance sampling scheme based on density ratio estimation mitigates the distribution mismatch between relabeled and real samples, enhancing training quality and stability. Experimental results show that the proposed method outperforms baseline methods in convergence, final return, and training stability, while achieving higher tracking accuracy and better dynamic response in typical contact scenarios, demonstrating strong effectiveness and robustness for robotic contact control in unstructured environments.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Mechatronic Engineering, Changchun University of Science and Technology, Changchun 130022, China.
- Chongqing Research Institute, Changchun University of Science and Technology, Chongqing 401133, China.
ORCID-Profile: Han Hou
Förderung
- Equipment Development Department of the Central Military Commission
- Equipment Development Department of the Central Military Commission of the People’s Republic of China
Zitieren
APA
Guo, X., Ding, H., Ning, X., Hou, H., & Cai, J. (2026). Variable-Damping Impedance Control for Contact Tasks: A Reinforcement Learning Method Integrating HER and Importance Sampling. Sensors, 26(14), 4538. https://doi.org/10.3390/s26144538
Vancouver
Guo X, Ding H, Ning X, Hou H, Cai J. Variable-Damping Impedance Control for Contact Tasks: A Reinforcement Learning Method Integrating HER and Importance Sampling. Sensors. 2026;26(14):4538. doi:10.3390/s26144538
BibTeX
@article{Guo2026,
author = {Guo, Xiaoqiang and Ding, Hongchang and Ning, Xin and Hou, Han and Cai, Jinhua},
title = {Variable-Damping Impedance Control for Contact Tasks: A Reinforcement Learning Method Integrating HER and Importance Sampling},
journal = {Sensors},
year = {2026},
volume = {26},
number = {14},
pages = {4538},
doi = {10.3390/s26144538}
}
EUVIMED