EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Description length of canonical and microcanonical models

Francesca Giuffrida, Tiziano Squartini, Peter Grünwald, Diego Garlaschelli

Physical Review Research · 16.10.2025 · 7 (4)

DOI: 10.1103/1sd2-rxmy ↗

Kurz gefasst

Fachartikel in der Zeitschrift Physical Review Research, online erschienen am 16.10.2025. Verfasst von Francesca Giuffrida und 3 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NextGenerationEU, European Commission.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The (non)equivalence of canonical and microcanonical ensembles is a fundamental question in statistical physics, concerning whether the use of soft and hard constraints in the maximum-entropy construction leads to the same description of a system. Despite the fact that maximum-entropy models are also commonly used in statistical inference, pattern detection, and hypothesis testing, a complete understanding of the effects of ensemble nonequivalence on statistical modeling is still missing. Here, we study this problem from a rigorous model selection perspective by comparing canonical and microcanonical models via the minimum description length principle, which yields a trade-off between likelihood, measuring model accuracy, and complexity, measuring model flexibility and its potential to overfit data. We compute the normalized maximum likelihood (NML) of both formulations and find that (1) microcanonical models always achieve higher likelihood but are always more complex; (2) the optimal model choice depends on the empirical values of the constraints—the canonical model performs best when its fit to the observed data exceeds its uniform average fit across all realizations; (3) in the thermodynamic limit, the difference in description length per node vanishes when ensemble equivalence holds but persists otherwise, showing that nonequivalence implies extensive differences between large canonical and microcanonical models. Finally, we compare the NML approach to Bayesian methods, showing that (4) the choice of priors, practically irrelevant in equivalent models, becomes crucial when an extensive number of constraints are enforced, possibly leading to very different outcomes.

Förderung

  • NextGenerationEU
  • European Commission

Zitieren

APA

Giuffrida, F., Squartini, T., Grünwald, P., & Garlaschelli, D. (2025). Description length of canonical and microcanonical models. Physical Review Research, 7(4). https://doi.org/10.1103/1sd2-rxmy

Vancouver

Giuffrida F, Squartini T, Grünwald P, Garlaschelli D. Description length of canonical and microcanonical models. Physical Review Research. 2025;7(4). doi:10.1103/1sd2-rxmy

BibTeX
@article{Giuffrida2025,
  author = {Giuffrida, Francesca and Squartini, Tiziano and Grünwald, Peter and Garlaschelli, Diego},
  title = {Description length of canonical and microcanonical models},
  journal = {Physical Review Research},
  year = {2025},
  volume = {7},
  number = {4},
  doi = {10.1103/1sd2-rxmy}
}
Kostenlos starten →