AUPO – Abstracted Until Proven Otherwise: A Reward Distribution Based Abstraction Algorithm
Proceedings of the International Conference on Automated Planning and Scheduling · 08.06.2026 · 36 (1) · 256-265
DOI: 10.1609/icaps.v36i1.42835 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the International Conference on Automated Planning and Scheduling, online erschienen am 08.06.2026. Verfasst von Robin Schmöcker und 2 weiteren Autor:innen.
Abstract (Originalsprache)
We introduce a novel, drop-in modification to Monte Carlo Tree Search's (MCTS) decision policy that we call AUPO. Comparisons based on a range of IPPC benchmark problems show that AUPO outperforms vanilla MCTS in domains with dense rewards and value-equivalent sibling actions under finite iteration budgets. AUPO is an automatic action abstraction algorithm that solely relies on reward distribution statistics acquired during the MCTS. Thus, unlike other automatic abstraction algorithms, AUPO requires neither access to transition probabilities nor does AUPO require a directed acyclic search graph to build its abstraction, allowing AUPO to detect symmetric actions that state-of-the-art frameworks like ASAP struggle with when the resulting symmetric states are far apart in state space. Furthermore, as AUPO only affects the decision policy, it is not mutually exclusive with other abstraction techniques that only affect the tree search.
Zitieren
APA
Schmöcker, R., Dockhorn, A., & Rosenhahn, B. (2026). AUPO – Abstracted Until Proven Otherwise: A Reward Distribution Based Abstraction Algorithm. Proceedings of the International Conference on Automated Planning and Scheduling, 36(1), 256-265. https://doi.org/10.1609/icaps.v36i1.42835
Vancouver
Schmöcker R, Dockhorn A, Rosenhahn B. AUPO – Abstracted Until Proven Otherwise: A Reward Distribution Based Abstraction Algorithm. Proceedings of the International Conference on Automated Planning and Scheduling. 2026;36(1):256-265. doi:10.1609/icaps.v36i1.42835
BibTeX
@article{Schmcker2026,
author = {Schmöcker, Robin and Dockhorn, Alexander and Rosenhahn, Bodo},
title = {AUPO – Abstracted Until Proven Otherwise: A Reward Distribution Based Abstraction Algorithm},
journal = {Proceedings of the International Conference on Automated Planning and Scheduling},
year = {2026},
volume = {36},
number = {1},
pages = {256--265},
doi = {10.1609/icaps.v36i1.42835}
}
EUVIMED