EUVIMEDEUVIMED entdecken
Crossref

Multi-Objective Reinforcement Learning Based on Decomposition: A Taxonomy and Framework

Florian Felten, El-Ghazali Talbi, Grégoire Danoy

Journal of Artificial Intelligence Research · 26.02.2024 · 79 · 679-723

DOI: 10.1613/jair.1.15702 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Artificial Intelligence Research, online erschienen am 26.02.2024. Verfasst von Florian Felten und 2 weiteren Autor:innen. Die Arbeit wurde bisher 46-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-objective reinforcement learning (MORL) extends traditional RL by seeking policies making different compromises among conflicting objectives. The recent surge of interest in MORL has led to diverse studies and solving methods, often drawing from existing knowledge in multi-objective optimization based on decomposition (MOO/D). Yet, a clear categorization based on both RL and MOO/D is lacking in the existing literature. Consequently, MORL researchers face difficulties when trying to classify contributions within a broader context due to the absence of a standardized taxonomy. To tackle such an issue, this paper introduces multi-objective reinforcement learning based on decomposition (MORL/D), a novel methodology bridging the literature of RL and MOO. A comprehensive taxonomy for MORL/D is presented, providing a structured foundation for categorizing existing and potential MORL works. The introduced taxonomy is then used to scrutinize MORL research, enhancing clarity and conciseness through well-defined categorization. Moreover, a flexible framework derived from the taxonomy is introduced. This framework accommodates diverse instantiations using tools from both RL and MOO/D. Its versatility is demonstrated by implementing it in different configurations and assessing it on contrasting benchmark problems. Results indicate MORL/D instantiations achieve comparable performance to current state-of-the-art approaches on the studied problems. By presenting the taxonomy and framework, this paper offers a comprehensive perspective and a unified vocabulary for MORL. This not only facilitates the identification of algorithmic contributions but also lays the groundwork for novel research avenues in MORL.

Zitieren

APA

Felten, F., Talbi, E., & Danoy, G. (2024). Multi-Objective Reinforcement Learning Based on Decomposition: A Taxonomy and Framework. Journal of Artificial Intelligence Research, 79, 679-723. https://doi.org/10.1613/jair.1.15702

Vancouver

Felten F, Talbi E, Danoy G. Multi-Objective Reinforcement Learning Based on Decomposition: A Taxonomy and Framework. Journal of Artificial Intelligence Research. 2024;79:679-723. doi:10.1613/jair.1.15702

BibTeX
@article{Felten2024,
  author = {Felten, Florian and Talbi, El-Ghazali and Danoy, Grégoire},
  title = {Multi-Objective Reinforcement Learning Based on Decomposition: A Taxonomy and Framework},
  journal = {Journal of Artificial Intelligence Research},
  year = {2024},
  volume = {79},
  pages = {679--723},
  doi = {10.1613/jair.1.15702}
}
Kostenlos starten →