EUVIMEDEUVIMED entdecken
Crossref

PQDA:Policy-Aligned Q-Consistency Meets Decoupled Augmentation for Generalizable Visual RL

Yun Zhou, Yuqiang Wu, Chunyu Tan

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (34) · 29080-29088

DOI: 10.1609/aaai.v40i34.40145 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Yun Zhou und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A fundamental challenge in visual reinforcement learning (RL) is achieving robust generalization across environments with varying visual distractions. Current RL methods struggle with generalization due to their inability to differentiate foreground and background features during augmentation,while their Q-consistency mechanisms rely on outdated actions from replay buffers that drift from the current policy.In this paper, we present PQDA, a novel framework that addresses generalization challenges in RL through two key innovations: (1) Foreground-Background Decoupled Augmentation leverages Gaussian mixture model-based segmentation to efficiently generate and cache masks in replay buffers, applying differentiated augmentation strategies to foreground and background regions, thereby enhancing data diversity while maintaining task-relevant features. (2) Policy-Aligned Q-Consistency enforces policy alignment by sampling actions from the current policy for Q-regularization, achieving faster and more stable convergence. Notably, PQDA eliminates auxiliary tasks entirely through a unified architecture that co-optimizes the encoder and RL components directly. Extensive experiments on DMControl benchmarks (including our newly proposed CVDMC benchmark) and robotic manipulation tasks demonstrate PQDA's superior generalization performance, outperforming state-of-the-art methods.

Zitieren

APA

Zhou, Y., Wu, Y., & Tan, C. (2026). PQDA:Policy-Aligned Q-Consistency Meets Decoupled Augmentation for Generalizable Visual RL. Proceedings of the AAAI Conference on Artificial Intelligence, 40(34), 29080-29088. https://doi.org/10.1609/aaai.v40i34.40145

Vancouver

Zhou Y, Wu Y, Tan C. PQDA:Policy-Aligned Q-Consistency Meets Decoupled Augmentation for Generalizable Visual RL. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(34):29080-29088. doi:10.1609/aaai.v40i34.40145

BibTeX
@article{Zhou2026,
  author = {Zhou, Yun and Wu, Yuqiang and Tan, Chunyu},
  title = {PQDA:Policy-Aligned Q-Consistency Meets Decoupled Augmentation for Generalizable Visual RL},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {34},
  pages = {29080--29088},
  doi = {10.1609/aaai.v40i34.40145}
}
Kostenlos starten →