Information Geometry and Asymptotic Theory for SMML Estimators
Entropy · 22.06.2026 · 28 (6) · 713
DOI: 10.3390/e28060713 ↗Kurz gefasst
Fachartikel in der Zeitschrift Entropy, online erschienen am 22.06.2026. Verfasst von Enes Makalic und 1 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Information Technology, Monash University, Clayton, VIC 3800, Australia. Die Arbeit nennt 19 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Strict minimum message length (SMML) is an information-theoretic coding principle that represents a continuous statistical model by a finite set of assertions and a partition of the sample space. We show that the SMML objective decomposes into assertion entropy and conditional cross-entropy, balancing the cost of identifying an assertion against the cost of encoding data under the assigned model. For any fixed partition, the optimal codepoint for each cell is the model distribution that minimises Kullback–Leibler (KL) divergence from the data distribution restricted to that cell. Using the local Fisher–Rao geometry of regular parametric models, we show that, under a high-resolution LAN-scale regime, SMML partitions are asymptotically the pullback, through the maximum-likelihood estimator, of weighted Fisher–Rao Voronoi tessellations in parameter space, with assertion probabilities appearing as additive weights. For regular canonical exponential families, SMML codepoints satisfy a moment-matching condition and admit an interpretation as KL/Bregman centroids, while exact SMML cells are pullbacks of convex polyhedra in sufficient-statistic space. Together, these results show that SMML induces a natural information-geometric quantisation linking entropy-based coding, KL projection, and divergence-based Voronoi geometry.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Information Technology, Monash University, Clayton, VIC 3800, Australia.
ORCID-Profile: Enes Makalic, Daniel F Schmidt
Zitieren
APA
Makalic, E., & Schmidt, D. F. (2026). Information Geometry and Asymptotic Theory for SMML Estimators. Entropy, 28(6), 713. https://doi.org/10.3390/e28060713
Vancouver
Makalic E, Schmidt DF. Information Geometry and Asymptotic Theory for SMML Estimators. Entropy. 2026;28(6):713. doi:10.3390/e28060713
BibTeX
@article{Makalic2026,
author = {Makalic, Enes and Schmidt, Daniel F},
title = {Information Geometry and Asymptotic Theory for SMML Estimators},
journal = {Entropy},
year = {2026},
volume = {28},
number = {6},
pages = {713},
doi = {10.3390/e28060713}
}
EUVIMED