EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Distance-Aware World Model-Based Reinforcement Learning for Mobile Manipulation Behaviors

Xiaoxu Feng, Takato Horii

IEEE Access · 2026 · 14 · 78614-78629

DOI: 10.1109/access.2026.3695694 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Xiaoxu Feng und 1 weiteren Autor:innen. Die Arbeit nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency Moonshot Research and Development.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Separate control of mobile manipulation offers a promising paradigm for managing its complexity by planning for these modalities independently. However, end-to-end learning of such behaviors necessitates effective mechanisms for both embodiment selection and motion planning. For low-level motion planning, prior world model-based reinforcement learning (RL) approaches have employed the similarity of latent states as a dense reward proxy. However, using latent similarity as an implicit distance metric yields inaccurate representations and depends heavily on predefined goal states. In this work, we address the limitations of similarity-based rewards by explicitly integrating 3D spatial information into the world model and deriving more accurate rewards from that distance-aware model for policy training. For high-level embodiment selection, prior model-based methods have either utilized reachability rewards inferred from predicted task rewards or relied on heuristic composite rewards. In this study, we retain the reachability reward and demonstrate that it yields superior performance in embodiment selection compared with composite reward formulations. By combining reachability-based selection and distance-guided planning, the model improves the performance of end-to-end learning for separate mobile manipulation behaviors. Extensive evaluations were conducted across two simulation environments with both fixed and randomized target settings. For motion planning, the distance reward achieves near 100% success rates across all configurations, significantly outperforming the baseline similarity reward, which achieves only 60% success in fixed-target scenarios and drops below 20% when targets are randomized. Regarding embodiment selection, the reachability-based separate control rapidly achieves a stable result with over 85% of arm activations occurring rationally within the near-goal region. Conversely, the heuristic composite reward slowly increases to a maximum of 60% for near-goal arm selections. These findings validate that the reachability reward provides a more effective and efficient mechanism for embodiment selection.

Förderung

  • Japan Science and Technology Agency Moonshot Research and Development

Zitieren

APA

Feng, X., & Horii, T. (2026). Distance-Aware World Model-Based Reinforcement Learning for Mobile Manipulation Behaviors. IEEE Access, 14, 78614-78629. https://doi.org/10.1109/access.2026.3695694

Vancouver

Feng X, Horii T. Distance-Aware World Model-Based Reinforcement Learning for Mobile Manipulation Behaviors. IEEE Access. 2026;14:78614-78629. doi:10.1109/access.2026.3695694

BibTeX
@article{Feng2026,
  author = {Feng, Xiaoxu and Horii, Takato},
  title = {Distance-Aware World Model-Based Reinforcement Learning for Mobile Manipulation Behaviors},
  journal = {IEEE Access},
  year = {2026},
  volume = {14},
  pages = {78614--78629},
  doi = {10.1109/access.2026.3695694}
}
Kostenlos starten →