Entropy Estimators for Markovian Sequences: A Comparative Analysis
Entropy · 17.01.2024 · 26 (1) · 79
DOI: 10.3390/e26010079 ↗Kurz gefasst
Fachartikel in der Zeitschrift Entropy, online erschienen am 17.01.2024. Verfasst von Juan De Gregorio und 2 weiteren Autor:innen. Beteiligte Einrichtung: Institute for Cross-Disciplinary Physics and Complex Systems IFISC (UIB-CSIC), Campus Universitat de les Illes Balears, E-07122 Palma de Mallorca, Sp…. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Agencia Estatal de Investigación, Fondo Europeo de Desarrollo Regional, María de Maeztu Program for units of Excellence in R&D.
Abstract (Originalsprache)
Entropy estimation is a fundamental problem in information theory that has applications in various fields, including physics, biology, and computer science. Estimating the entropy of discrete sequences can be challenging due to limited data and the lack of unbiased estimators. Most existing entropy estimators are designed for sequences of independent events and their performances vary depending on the system being studied and the available data size. In this work, we compare different entropy estimators and their performance when applied to Markovian sequences. Specifically, we analyze both binary Markovian sequences and Markovian systems in the undersampled regime. We calculate the bias, standard deviation, and mean squared error for some of the most widely employed estimators. We discuss the limitations of entropy estimation as a function of the transition probabilities of the Markov processes and the sample size. Overall, this paper provides a comprehensive comparison of entropy estimators and their performance in estimating entropy for systems with memory, which can be useful for researchers and practitioners in various fields.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute for Cross-Disciplinary Physics and Complex Systems IFISC (UIB-CSIC), Campus Universitat de les Illes Balears, E-07122 Palma de Mallorca, Spain.
ORCID-Profile: Juan De Gregorio, David Sánchez, Raúl Toral
Förderung
- Agencia Estatal de Investigación
- Fondo Europeo de Desarrollo Regional
- María de Maeztu Program for units of Excellence in R&D
Zitieren
APA
De Gregorio, J., Sánchez, D., & Toral, R. (2024). Entropy Estimators for Markovian Sequences: A Comparative Analysis. Entropy, 26(1), 79. https://doi.org/10.3390/e26010079
Vancouver
De Gregorio J, Sánchez D, Toral R. Entropy Estimators for Markovian Sequences: A Comparative Analysis. Entropy. 2024;26(1):79. doi:10.3390/e26010079
BibTeX
@article{DeGregorio2024,
author = {De Gregorio, Juan and Sánchez, David and Toral, Raúl},
title = {Entropy Estimators for Markovian Sequences: A Comparative Analysis},
journal = {Entropy},
year = {2024},
volume = {26},
number = {1},
pages = {79},
doi = {10.3390/e26010079}
}
EUVIMED