EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Finite-Resolution Information from Collision Statistics

Alexander J Gates iD

Entropy · 05.08.2026 · 28 (8) · 882

DOI: 10.3390/e28080882 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 05.08.2026. Verfasst von Alexander J Gates. Beteiligte Einrichtung: School of Data Science, University of Virginia, Charlottesville, VA 22903, USA. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Security Data & Policy Institute.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Collision statistics provide a finite-resolution view of information by measuring how often independent samples fall on the same state and form the basis of integer-order Rényi entropies. Here, we use low-order Rényi entropies to characterize finite-resolution approximations to Shannon entropy and mutual information. Specifically, we determine what population information is captured by finite collision moments, we quantify how the resulting targets differ from their Shannon counterparts, and we analyze how accurately they can be estimated from finite samples. We use the interpolation remainder to identify structural approximation error induced by extrapolating from integer-order Rényi entropies to the Shannon point. We separate this deterministic error from finite-sample estimation error: increasing sample size improves estimation of a finite-resolution target but does not eliminate its deterministic difference from Shannon entropy or mutual information. Finally, we show that finite collision moments do not generally identify Shannon entropy, and that increasing collision order shifts sensitivity toward high-probability events. Our numerical experiments illustrate the approximation–estimation trade-off and evaluate collision-based approximations alongside plug-in and Miller–Madow estimators. Together, these results provide a principled way to use low-order coincidence structure as finite-resolution information, while making explicit what finite collision moments can and cannot reveal about Shannon entropy and mutual information.

Schlagwörter

Stichwörter der Autor:innen

Rényi entropyShannon entropycollision probabilityfinite-sample estimationmutual informationpower sums

Autor:innen und Institutionen

  • School of Data Science, University of Virginia, Charlottesville, VA 22903, USA.

ORCID-Profile: Alexander J Gates

Förderung

  • National Security Data & Policy Institute

Zitieren

APA

Gates, A. J. (2026). Finite-Resolution Information from Collision Statistics. Entropy, 28(8), 882. https://doi.org/10.3390/e28080882

Vancouver

Gates AJ. Finite-Resolution Information from Collision Statistics. Entropy. 2026;28(8):882. doi:10.3390/e28080882

BibTeX
@article{Gates2026,
  author = {Gates, Alexander J},
  title = {Finite-Resolution Information from Collision Statistics},
  journal = {Entropy},
  year = {2026},
  volume = {28},
  number = {8},
  pages = {882},
  doi = {10.3390/e28080882}
}
Kostenlos starten →