PQDA:Policy-Aligned Q-Consistency Meets Decoupled Augmentation for Generalizable Visual RL
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (34) · 29080-29088
DOI: 10.1609/aaai.v40i34.40145 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Yun Zhou und 2 weiteren Autor:innen.
Abstract (Originalsprache)
A fundamental challenge in visual reinforcement learning (RL) is achieving robust generalization across environments with varying visual distractions. Current RL methods struggle with generalization due to their inability to differentiate foreground and background features during augmentation,while their Q-consistency mechanisms rely on outdated actions from replay buffers that drift from the current policy.In this paper, we present PQDA, a novel framework that addresses generalization challenges in RL through two key innovations: (1) Foreground-Background Decoupled Augmentation leverages Gaussian mixture model-based segmentation to efficiently generate and cache masks in replay buffers, applying differentiated augmentation strategies to foreground and background regions, thereby enhancing data diversity while maintaining task-relevant features. (2) Policy-Aligned Q-Consistency enforces policy alignment by sampling actions from the current policy for Q-regularization, achieving faster and more stable convergence. Notably, PQDA eliminates auxiliary tasks entirely through a unified architecture that co-optimizes the encoder and RL components directly. Extensive experiments on DMControl benchmarks (including our newly proposed CVDMC benchmark) and robotic manipulation tasks demonstrate PQDA's superior generalization performance, outperforming state-of-the-art methods.
Zitieren
APA
Zhou, Y., Wu, Y., & Tan, C. (2026). PQDA:Policy-Aligned Q-Consistency Meets Decoupled Augmentation for Generalizable Visual RL. Proceedings of the AAAI Conference on Artificial Intelligence, 40(34), 29080-29088. https://doi.org/10.1609/aaai.v40i34.40145
Vancouver
Zhou Y, Wu Y, Tan C. PQDA:Policy-Aligned Q-Consistency Meets Decoupled Augmentation for Generalizable Visual RL. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(34):29080-29088. doi:10.1609/aaai.v40i34.40145
BibTeX
@article{Zhou2026,
author = {Zhou, Yun and Wu, Yuqiang and Tan, Chunyu},
title = {PQDA:Policy-Aligned Q-Consistency Meets Decoupled Augmentation for Generalizable Visual RL},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {34},
pages = {29080--29088},
doi = {10.1609/aaai.v40i34.40145}
}
EUVIMED