Finite-Horizon Performance Estimation for Online Parameter Refinement in RL–MPC Quadrupedal Locomotion
Applied Sciences · 19.11.2026 · 16 (22) · 11478
DOI: 10.3390/app162211478 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 19.11.2026. Verfasst von Chengleng Han und 1 weiteren Autor:innen. Die Arbeit nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: China Hubei Province Key R&D Program.
Abstract (Originalsprache)
Reinforcement learning integrated with model predictive control (RL-MPC) enables adaptive quadrupedal locomotion, but learned controller parameters do not explicitly account for their subsequent closed-loop performance. This study proposes a finite-horizon performance estimator (FHPE) to guide online parameter refinement. Trained on rollout data, FHPE predicts the finite-horizon performance of local parameter candidates to guide constrained refinement of the nominal RL proposal. The refined parameters are implemented through MPC and Adaptive Impedance Modulation (AIM), while Transient Residual Compensation (TRC) regulates joint-level responses through spectral regularization and risk-dependent gating. Ablation studies show that FHPE-guided refinement reduces the combined performance cost by 12.68% compared with equal-budget search, while AIM and TRC improve execution performance and transient regulation. Robot performance evaluations demonstrate improved high-speed locomotion capability, an approximately 26% reduction in peak joint acceleration on uneven terrain, and an approximately 43% reduction in estimated mechanical work over 10 m on flat ground in hardware experiments. These findings suggest that finite-horizon performance prediction can improve online parameter selection, while joint-level adaptation helps translate refined parameters into effective locomotion control.
Förderung
- China Hubei Province Key R&D Program
Zitieren
APA
Han, C., & Xu, L. (2026). Finite-Horizon Performance Estimation for Online Parameter Refinement in RL–MPC Quadrupedal Locomotion. Applied Sciences, 16(22), 11478. https://doi.org/10.3390/app162211478
Vancouver
Han C, Xu L. Finite-Horizon Performance Estimation for Online Parameter Refinement in RL–MPC Quadrupedal Locomotion. Applied Sciences. 2026;16(22):11478. doi:10.3390/app162211478
BibTeX
@article{Han2026,
author = {Han, Chengleng and Xu, Lin},
title = {Finite-Horizon Performance Estimation for Online Parameter Refinement in RL–MPC Quadrupedal Locomotion},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {22},
pages = {11478},
doi = {10.3390/app162211478}
}
EUVIMED