A Semi-Parallel Multi-Timescale Reinforcement Learning Method for Coordinated Motion Planning and Hydraulic Control of Mobile Manipulators
Applied Sciences · 30.10.2026 · 16 (21) · 10779
DOI: 10.3390/app162110779 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 30.10.2026. Verfasst von Feihong Liu und 1 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
For mobile manipulators, the global motion planning and hydraulic-system dynamic response operate on inherently mismatched timescales, making their coordinated control challenging. This paper proposes DASMT-PPO, a multi-timescale proximal policy optimization method with a dual-actor semi-parallel architecture. The proposed method preserves necessary information exchange across hierarchical levels while assigning distinct optimization roles to global task planning and hydraulic dynamic control. Specifically, the two actors optimize policies for global task planning and the rapid dynamic response of the hydraulic system, respectively. The multi-timescale mechanism updates the two policies at their corresponding timescales, thereby helping to reduce gradient interference between different control objectives. Meanwhile, the semi-parallel information flow maintains consistency between local dynamic corrections and global task objectives. Simulation results show that, compared with PPO, DASMT-PPO increases the task success rate from 82.5% to 94.0%, an improvement of 11.5 percentage points, and reduces the collision rate from 12.5% to 4.0%, a reduction of 8.5 percentage points. It also achieves higher episodic cumulative return and terminal control accuracy than SAC and TD3. The ablation results indicate that both the semi-parallel information flow and the combination of the dual-actor architecture with the multi-timescale mechanism contribute to improved algorithm performance.
Zitieren
APA
Liu, F., & Liang, Q. (2026). A Semi-Parallel Multi-Timescale Reinforcement Learning Method for Coordinated Motion Planning and Hydraulic Control of Mobile Manipulators. Applied Sciences, 16(21), 10779. https://doi.org/10.3390/app162110779
Vancouver
Liu F, Liang Q. A Semi-Parallel Multi-Timescale Reinforcement Learning Method for Coordinated Motion Planning and Hydraulic Control of Mobile Manipulators. Applied Sciences. 2026;16(21):10779. doi:10.3390/app162110779
BibTeX
@article{Liu2026,
author = {Liu, Feihong and Liang, Quan},
title = {A Semi-Parallel Multi-Timescale Reinforcement Learning Method for Coordinated Motion Planning and Hydraulic Control of Mobile Manipulators},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {21},
pages = {10779},
doi = {10.3390/app162110779}
}
EUVIMED