Complete Diagrammatic Axiomatisations of Relative Entropy
Electronic Notes in Theoretical Informatics and Computer Science · 04.11.2026 · Volume 6: Proceedings of MFPS...
DOI: 10.46298/entics.18985 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronic Notes in Theoretical Informatics and Computer Science, online erschienen am 04.11.2026. Verfasst von Ralph Sarkis und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Relative entropy is a fundamental class of distances between probability distributions, with widespread applications in probability theory, statistics, and machine learning. In this work, we study relative entropy from a categorical perspective, viewing it as a quantitative enrichment of categories of stochastic matrices. We consider two natural monoidal structures on stochastic matrices, given by the Kronecker product and the direct sum. Our main results are complete axiomatisations of Kullback-Leibler divergence and, more generally, of Rényi divergences of arbitrary order, for each such structure. Our axiomatic theories are formulated within the framework of quantitative monoidal algebra, using a graphical language of string diagrams enriched with quantitative equations.
Zitieren
APA
Sarkis, R., & Zanasi, F. (2026). Complete Diagrammatic Axiomatisations of Relative Entropy. Electronic Notes in Theoretical Informatics and Computer Science, Volume 6: Proceedings of MFPS.... https://doi.org/10.46298/entics.18985
Vancouver
Sarkis R, Zanasi F. Complete Diagrammatic Axiomatisations of Relative Entropy. Electronic Notes in Theoretical Informatics and Computer Science. 2026;Volume 6: Proceedings of MFPS.... doi:10.46298/entics.18985
BibTeX
@article{Sarkis2026,
author = {Sarkis, Ralph and Zanasi, Fabio},
title = {Complete Diagrammatic Axiomatisations of Relative Entropy},
journal = {Electronic Notes in Theoretical Informatics and Computer Science},
year = {2026},
volume = {Volume 6: Proceedings of MFPS...},
doi = {10.46298/entics.18985}
}
EUVIMED