EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Network Reconstruction via the Minimum Description Length Principle

Tiago P. Peixoto

Physical Review X · 20.03.2025 · 15 (1)

DOI: 10.1103/physrevx.15.011065 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Physical Review X, online erschienen am 20.03.2025. Verfasst von Tiago P. Peixoto. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 83 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Vienna Science and Technology Fund, Central European University, State of Lower Austria.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A fundamental problem associated with the task of network reconstruction from dynamical or behavioral data consists in determining the most appropriate model complexity in a manner that prevents overfitting and produces an inferred network with a statistically justifiable number of edges and their weight distribution. The status quo in this context is based on L 1 regularization combined with cross-validation. However, besides its high computational cost, this commonplace approach unnecessarily ties the promotion of sparsity, i.e., abundance of zero weights, with weight “shrinkage.” This combination forces a trade-off between the bias introduced by shrinkage and the network sparsity, which often results in substantial overfitting even after cross-validation. In this work, we propose an alternative nonparametric regularization scheme based on hierarchical Bayesian inference and weight quantization, which does not rely on weight shrinkage to promote sparsity. Our approach follows the minimum description length principle, and uncovers the weight distribution that allows for the most compression of the data, thus avoiding overfitting without requiring cross-validation. The latter property renders our approach substantially faster and simpler to employ, as it requires a single fit to the complete data, instead of many fits for multiple data splits and choice of regularization parameter. As a result, we have a principled and efficient inference scheme that can be used with a large variety of generative models, without requiring the number of reconstructed edges and their weight distribution to be known in advance. In a series of examples, we also demonstrate that our scheme yields systematically increased accuracy in the reconstruction of both artificial and empirical networks. We highlight the use of our method with the reconstruction of interaction networks between microbial communities from large-scale abundance samples involving on the order of 10 4 – 10 5 species and demonstrate how the inferred model can be used to predict the outcome of potential interventions and tipping points in the system.

Förderung

  • Vienna Science and Technology Fund
  • Central European University
  • State of Lower Austria

Zitieren

APA

Peixoto, T. P. (2025). Network Reconstruction via the Minimum Description Length Principle. Physical Review X, 15(1). https://doi.org/10.1103/physrevx.15.011065

Vancouver

Peixoto TP. Network Reconstruction via the Minimum Description Length Principle. Physical Review X. 2025;15(1). doi:10.1103/physrevx.15.011065

BibTeX
@article{Peixoto2025,
  author = {Peixoto, Tiago P.},
  title = {Network Reconstruction via the Minimum Description Length Principle},
  journal = {Physical Review X},
  year = {2025},
  volume = {15},
  number = {1},
  doi = {10.1103/physrevx.15.011065}
}
Kostenlos starten →