EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Free Energy Projective Simulation (FEPS): Active inference with interpretability

Joséphine Pazem iD, Marius Krumm, Alexander Q Vining, Lukas J Fiderer iD, Hans J Briegel

PLOS One · 2025

DOI: 10.1371/journal.pone.0331047 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS One, 2025. Verfasst von Joséphine Pazem und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institut für Theoretische Physik, Universität Innsbruck, Innsbruck, Austria. Hauptthemen laut MEDLINE: Computer Simulation. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 100 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Austrian Science Fund, European Union.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the last decade, the free energy principle (FEP) and active inference (AIF) have achieved many successes connecting conceptual models of learning and cognition to mathematical models of perception and action. This effort is driven by a multidisciplinary interest in understanding aspects of self-organizing complex adaptive systems, including elements of agency. Various reinforcement learning (RL) models performing active inference have been proposed and trained on standard RL tasks using deep neural networks. Recent work has focused on improving such agents’ performance in complex environments by incorporating the latest machine learning techniques. In this paper, we build upon these techniques. Within the constraints imposed by the FEP and AIF, we attempt to model agents in an interpretable way without deep neural networks by introducing Free Energy Projective Simulation (FEPS). Using internal rewards only, FEPS agents build a representation of their partially observable environments with which they interact. Following AIF, the policy to achieve a given task is derived from this world model by minimizing the expected free energy. Leveraging the interpretability of the model, techniques are introduced to deal with long-term goals and reduce prediction errors caused by erroneous hidden state estimation. We test the FEPS model on two RL environments inspired from behavioral biology: a timed response task and a navigation task in a partially observable grid. Our results show that FEPS agents fully resolve the ambiguity of both environments by appropriately contextualizing their observations based on prediction accuracy only. In addition, they infer optimal policies flexibly for any target observation in the environment.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Computer SimulationHumansNeural Networks, ComputerReinforcement, PsychologyMachine LearningCognitionModels, Theoretical

Autor:innen und Institutionen

  • Institut für Theoretische Physik, Universität Innsbruck, Innsbruck, Austria.
  • Department for the Ecology of Animal Societies, Max Planck Institute of Animal Behavior, Konstanz, Germany.
  • Department of Philosophy, University of Konstanz, Konstanz, Germany.

ORCID-Profile: Joséphine Pazem, Lukas J Fiderer

Förderung

  • Austrian Science Fund
  • European Union

Zitieren

APA

Pazem, J., Krumm, M., Vining, A. Q., Fiderer, L. J., & Briegel, H. J. (2025). Free Energy Projective Simulation (FEPS): Active inference with interpretability. PLOS One. https://doi.org/10.1371/journal.pone.0331047

Vancouver

Pazem J, Krumm M, Vining AQ, Fiderer LJ, Briegel HJ. Free Energy Projective Simulation (FEPS): Active inference with interpretability. PLOS One. 2025. doi:10.1371/journal.pone.0331047

BibTeX
@article{Pazem2025,
  author = {Pazem, Joséphine and Krumm, Marius and Vining, Alexander Q and Fiderer, Lukas J and Briegel, Hans J},
  title = {Free Energy Projective Simulation (FEPS): Active inference with interpretability},
  journal = {PLOS One},
  year = {2025},
  doi = {10.1371/journal.pone.0331047}
}
Kostenlos starten →