Online and offline learning of player objectives from partial observations in dynamic games
The International Journal of Robotics Research · 2023-09 · 42 (10) · 917-937
DOI: 10.1177/02783649231182453 ↗Kurz gefasst
Fachartikel in der Zeitschrift The International Journal of Robotics Research, online erschienen am 18.06.2023. Verfasst von Lasse Peters und 6 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Robots deployed to the real world must be able to interact with other agents in their environment. Dynamic game theory provides a powerful mathematical framework for modeling scenarios in which agents have individual objectives and interactions evolve over time. However, a key limitation of such techniques is that they require a priori knowledge of all players’ objectives. In this work, we address this issue by proposing a novel method for learning players’ objectives in continuous dynamic games from noise-corrupted, partial state observations. Our approach learns objectives by coupling the estimation of unknown cost parameters of each player with inference of unobserved states and inputs through Nash equilibrium constraints. By coupling past state estimates with future state predictions, our approach is amenable to simultaneous online learning and prediction in receding horizon fashion. We demonstrate our method in several simulated traffic scenarios in which we recover players’ preferences, for, e.g. desired travel speed and collision-avoidance behavior. Results show that our method reliably estimates game-theoretic models from noise-corrupted data that closely matches ground-truth objectives, consistently outperforming state-of-the-art approaches.
Zitieren
APA
Peters, L., Rubies-Royo, V., Tomlin, C. J., Ferranti, L., Alonso-Mora, J., Stachniss, C., & Fridovich-Keil, D. (2023). Online and offline learning of player objectives from partial observations in dynamic games. The International Journal of Robotics Research, 42(10), 917-937. https://doi.org/10.1177/02783649231182453
Vancouver
Peters L, Rubies-Royo V, Tomlin CJ, Ferranti L, Alonso-Mora J, Stachniss C, et al. Online and offline learning of player objectives from partial observations in dynamic games. The International Journal of Robotics Research. 2023;42(10):917-937. doi:10.1177/02783649231182453
BibTeX
@article{Peters2023,
author = {Peters, Lasse and Rubies-Royo, Vicenç and Tomlin, Claire J and Ferranti, Laura and Alonso-Mora, Javier and Stachniss, Cyrill and Fridovich-Keil, David},
title = {Online and offline learning of player objectives from partial observations in dynamic games},
journal = {The International Journal of Robotics Research},
year = {2023},
volume = {42},
number = {10},
pages = {917--937},
doi = {10.1177/02783649231182453}
}
EUVIMED