Information-Theoretic Intrinsic Motivation for Reinforcement Learning in Combinatorial Routing
Entropy · 27.01.2026 · 28 (2) · 140
DOI: 10.3390/e28020140 ↗Kurz gefasst
Fachartikel in der Zeitschrift Entropy, online erschienen am 27.01.2026. Verfasst von Ruozhang Xi und 2 weiteren Autor:innen. Beteiligte Einrichtung: Krieger School of Arts and Sciences, Johns Hopkins University, Washington, DC 20001, USA. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Guangdong Basic and Applied Basic Research Foundation, Science and Technology Projects in Guangzhou, Key Science and Technology Program of Henan Province.
Abstract (Originalsprache)
Intrinsic motivation provides a principled mechanism for driving exploration in reinforcement learning when external rewards are sparse or delayed. A central challenge, however, lies in defining meaningful novelty signals in high-dimensional and combinatorial state spaces, where observation-level density estimation and prediction-error heuristics often become unreliable. In this work, we propose an information-theoretic framework for intrinsically motivated reinforcement learning grounded in the Information Bottleneck principle. Our approach learns compact latent state representations by explicitly balancing the compression of observations and the preservation of predictive information about future state transitions. Within this bottlenecked latent space, intrinsic rewards are defined through information-theoretic quantities that characterize the novelty of state–action transitions in terms of mutual information, rather than raw observation dissimilarity. To enable scalable estimation in continuous and high-dimensional settings, we employ neural mutual information estimators that avoid explicit density modeling and contrastive objectives based on the construction of positive–negative pairs. We evaluate the proposed method on two representative combinatorial routing problems, the Travelling Salesman Problem and the Split Delivery Vehicle Routing Problem, formulated as Markov decision processes with sparse terminal rewards. These problems serve as controlled testbeds for studying exploration and representation learning under long-horizon decision making. Experimental results demonstrate that the proposed information bottleneck-driven intrinsic motivation improves exploration efficiency, training stability, and solution quality compared to standard reinforcement learning baselines.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Krieger School of Arts and Sciences, Johns Hopkins University, Washington, DC 20001, USA.
- School of Integrated Circuit Engineering, Guangdong University of Technology, Guangzhou 510006, China.
- School of Computer Science, University of Liverpool, Liverpool L69 3DR, UK.
Förderung
- Guangdong Basic and Applied Basic Research Foundation
- Science and Technology Projects in Guangzhou
- Key Science and Technology Program of Henan Province
Zitieren
APA
Xi, R., Ni, Y., & Wu, W. (2026). Information-Theoretic Intrinsic Motivation for Reinforcement Learning in Combinatorial Routing. Entropy, 28(2), 140. https://doi.org/10.3390/e28020140
Vancouver
Xi R, Ni Y, Wu W. Information-Theoretic Intrinsic Motivation for Reinforcement Learning in Combinatorial Routing. Entropy. 2026;28(2):140. doi:10.3390/e28020140
BibTeX
@article{Xi2026,
author = {Xi, Ruozhang and Ni, Yao and Wu, Wangyu},
title = {Information-Theoretic Intrinsic Motivation for Reinforcement Learning in Combinatorial Routing},
journal = {Entropy},
year = {2026},
volume = {28},
number = {2},
pages = {140},
doi = {10.3390/e28020140}
}
EUVIMED