Process empowerment for robust intrinsic motivation
Journal of Physics: Complexity · 01.09.2025 · 6 (3) · 035011
DOI: 10.1088/2632-072x/adf2ec ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Physics: Complexity, online erschienen am 26.08.2025. Verfasst von Stas Tiomkin und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: PAZY Foundation, Division of Information and Intelligent Systems.
Abstract (Originalsprache)
Information processing in dynamical control systems influences the properties of the perception-action loop in natural and artificial agents. The ability to causally affect environment by agent’s actions is crucial for learning meaningful behavior and survival. Empowerment is an information-theoretic approach to intrinsically discover this causality between actions and observations without externally provided domain expertise such as a reward function. This form of artificial intrinsic motivation has been successfully demonstrated to lead to the emergence of meaningful behavior in various domains ranging from robotics to transportation. The original formulation of the empowerment principle is based on the information flow from open-loop actions to future observations. This is not robust to randomness and unpredictable perturbations in environments with structures that require careful maneuvering. In this work we define a feedback-aware empowerment variant, called process empowerment and derive a solution given by self-consistent equations which can be used for its numerical evaluation. Process empowerment proves to be a robust intrinsic motivation in a paradigmatic proof-of-concept example (‘Windy Bridge’), and in scenarios with obstacles and noisy perturbation (‘Hallway’) and with occasional adversarial action by an oracle agent (‘Race’). It demonstrates superior robustness in dealing with noisy environments in delicate situations, and allows transferring solutions for deterministic problems into a noisy, disruptive and occasionally adversarial variant of the problem, through ‘empowerment cushioning’.
Förderung
- PAZY Foundation
- Division of Information and Intelligent Systems
Zitieren
APA
Tiomkin, S., Salge, C., & Polani, D. (2025). Process empowerment for robust intrinsic motivation. Journal of Physics: Complexity, 6(3), 035011. https://doi.org/10.1088/2632-072x/adf2ec
Vancouver
Tiomkin S, Salge C, Polani D. Process empowerment for robust intrinsic motivation. Journal of Physics: Complexity. 2025;6(3):035011. doi:10.1088/2632-072x/adf2ec
BibTeX
@article{Tiomkin2025,
author = {Tiomkin, Stas and Salge, Christoph and Polani, Daniel},
title = {Process empowerment for robust intrinsic motivation},
journal = {Journal of Physics: Complexity},
year = {2025},
volume = {6},
number = {3},
pages = {035011},
doi = {10.1088/2632-072x/adf2ec}
}
EUVIMED