MO-VLA: Preference Adaptation for Vision-Language-Action Models via Multi-Objective Reinforcement Learning
Proceedings of the International Conference on Automated Planning and Scheduling · 08.06.2026 · 36 (1) · 470-479
DOI: 10.1609/icaps.v36i1.42864 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the International Conference on Automated Planning and Scheduling, online erschienen am 08.06.2026. Verfasst von Yan Yang und 2 weiteren Autor:innen.
Abstract (Originalsprache)
Vision-Language-Action (VLA) models trained with large-scale behavior cloning (BC) have achieved substantial progress in producing diverse and complex robotic behaviors, and have been widely deployed on robot manipulation, human-robot cooperation, and autonomous driving tasks. However, existing VLA models focus on generating complex behaviors from generalized human instructions, at the expense of capturing the critical preference and intent information (regarding speed, smoothness, safety, etc. ) conveyed by users. To address this limitation, we propose MO-VLA, a two-stage framework that integrates Multi-Objective Reinforcement Learning (MORL) into VLA training. Our framework is designed to maintain the performance of the pre-trained model while accelerating convergence when modeling user preferences. It operates in two stages. First, behavioral cloning (BC) on large-scale demonstrations is used for equipping the model with general operational skills. Subsequently, a multi-objective reinforcement learning (MORL) based fine-tuning stage is used for adapting this policy to user-specific preferences. Here, a Feature-wise Linear Modulation (FiLM) mechanism is integrated into the action head to explicitly inject preference signals into the policy generation process. Experimental results on the Meta-World benchmark demonstrate that our method achieves superior multi-objective performance while maintaining a high task success rate. These results validate its capability for preference-aware action generation for various robotic tasks.
Zitieren
APA
Yang, Y., Wu, Y., & Jing, M. (2026). MO-VLA: Preference Adaptation for Vision-Language-Action Models via Multi-Objective Reinforcement Learning. Proceedings of the International Conference on Automated Planning and Scheduling, 36(1), 470-479. https://doi.org/10.1609/icaps.v36i1.42864
Vancouver
Yang Y, Wu Y, Jing M. MO-VLA: Preference Adaptation for Vision-Language-Action Models via Multi-Objective Reinforcement Learning. Proceedings of the International Conference on Automated Planning and Scheduling. 2026;36(1):470-479. doi:10.1609/icaps.v36i1.42864
BibTeX
@article{Yang2026,
author = {Yang, Yan and Wu, Yuquan and Jing, Mingxuan},
title = {MO-VLA: Preference Adaptation for Vision-Language-Action Models via Multi-Objective Reinforcement Learning},
journal = {Proceedings of the International Conference on Automated Planning and Scheduling},
year = {2026},
volume = {36},
number = {1},
pages = {470--479},
doi = {10.1609/icaps.v36i1.42864}
}
EUVIMED