A Benchmark for Entropy Estimators
Entropy · 10.03.2026 · 28 (3) · 311
DOI: 10.3390/e28030311 ↗Kurz gefasst
Fachartikel in der Zeitschrift Entropy, online erschienen am 10.03.2026. Verfasst von Lucio M Calcagnile und 2 weiteren Autor:innen. Beteiligte Einrichtung: Istituto di Biofisica, CNR, Via G. Moruzzi 1, 56124 Pisa, Italy. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Tuscany Health Ecosystem, European Union, Italian Ministry of Education, University and Research.
Abstract (Originalsprache)
This study assessed the performance of several entropy estimators for numerical time series and symbolic data on non-trivial one-dimensional dynamical systems whose Kolmogorov–Sinai entropy is known with certified accuracy: recent computer-assisted proof techniques provide rigorous values together with explicit error bounds. We considered four classes of interval maps, including piecewise expanding maps with and without a Markov partition and an intermittent Pomeau–Manneville map, and generated long orbits for each system. We then compared the certified entropy with the output of widely used estimators: Approximate Entropy, Sample Entropy, Permutation Entropy, a symbolic Plug-In estimator of the entropy rate, and the Non-Sequential Recursive Pair Substitution (NSRPS) method (the latter two with Grassberger-type bias correction). Our experiments reveal substantial, dynamics-dependent differences in accuracy and robustness. In particular, Approximate Entropy and the symbolic methods (Plug-In and NSRPS) consistently yielded estimates within the rigorous error bars across all systems, whereas Sample Entropy showed a marked systematic underestimation, and Permutation Entropy exhibited large biases, especially for expanding maps without a Markov partition. The resulting benchmark provides a quantitative testbed for evaluating entropy estimation techniques in deterministic dynamical systems.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Istituto di Biofisica, CNR, Via G. Moruzzi 1, 56124 Pisa, Italy.
- Dipartimento di Fisica, Università di Pisa, Via Buonarroti 1, 56127 Pisa, Italy.
- Dipartimento di Matematica, Università di Pisa, Via Buonarroti 1, 56127 Pisa, Italy.
ORCID-Profile: Lucio M Calcagnile, Angelo Di Garbo, Stefano Galatolo
Förderung
- Tuscany Health Ecosystem
- European Union
- Italian Ministry of Education, University and Research
- Department of Mathematics, University of Pisa
Zitieren
APA
Calcagnile, L. M., Di Garbo, A., & Galatolo, S. (2026). A Benchmark for Entropy Estimators. Entropy, 28(3), 311. https://doi.org/10.3390/e28030311
Vancouver
Calcagnile LM, Di Garbo A, Galatolo S. A Benchmark for Entropy Estimators. Entropy. 2026;28(3):311. doi:10.3390/e28030311
BibTeX
@article{Calcagnile2026,
author = {Calcagnile, Lucio M and Di Garbo, Angelo and Galatolo, Stefano},
title = {A Benchmark for Entropy Estimators},
journal = {Entropy},
year = {2026},
volume = {28},
number = {3},
pages = {311},
doi = {10.3390/e28030311}
}
EUVIMED