EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Entropy Estimators for Markovian Sequences: A Comparative Analysis

Juan De Gregorio iD, David Sánchez iD, Raúl Toral iD

Entropy · 17.01.2024 · 26 (1) · 79

DOI: 10.3390/e26010079 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 17.01.2024. Verfasst von Juan De Gregorio und 2 weiteren Autor:innen. Beteiligte Einrichtung: Institute for Cross-Disciplinary Physics and Complex Systems IFISC (UIB-CSIC), Campus Universitat de les Illes Balears, E-07122 Palma de Mallorca, Sp…. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 73 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Agencia Estatal de Investigación, Fondo Europeo de Desarrollo Regional, María de Maeztu Program for units of Excellence in R&D.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Entropy estimation is a fundamental problem in information theory that has applications in various fields, including physics, biology, and computer science. Estimating the entropy of discrete sequences can be challenging due to limited data and the lack of unbiased estimators. Most existing entropy estimators are designed for sequences of independent events and their performances vary depending on the system being studied and the available data size. In this work, we compare different entropy estimators and their performance when applied to Markovian sequences. Specifically, we analyze both binary Markovian sequences and Markovian systems in the undersampled regime. We calculate the bias, standard deviation, and mean squared error for some of the most widely employed estimators. We discuss the limitations of entropy estimation as a function of the transition probabilities of the Markov processes and the sample size. Overall, this paper provides a comprehensive comparison of entropy estimators and their performance in estimating entropy for systems with memory, which can be useful for researchers and practitioners in various fields.

Schlagwörter

Stichwörter der Autor:innen

Markovian systemsShannon entropydata analysisestimators

Autor:innen und Institutionen

  • Institute for Cross-Disciplinary Physics and Complex Systems IFISC (UIB-CSIC), Campus Universitat de les Illes Balears, E-07122 Palma de Mallorca, Spain.

ORCID-Profile: Juan De Gregorio, David Sánchez, Raúl Toral

Förderung

  • Agencia Estatal de Investigación
  • Fondo Europeo de Desarrollo Regional
  • María de Maeztu Program for units of Excellence in R&D

Zitieren

APA

De Gregorio, J., Sánchez, D., & Toral, R. (2024). Entropy Estimators for Markovian Sequences: A Comparative Analysis. Entropy, 26(1), 79. https://doi.org/10.3390/e26010079

Vancouver

De Gregorio J, Sánchez D, Toral R. Entropy Estimators for Markovian Sequences: A Comparative Analysis. Entropy. 2024;26(1):79. doi:10.3390/e26010079

BibTeX
@article{DeGregorio2024,
  author = {De Gregorio, Juan and Sánchez, David and Toral, Raúl},
  title = {Entropy Estimators for Markovian Sequences: A Comparative Analysis},
  journal = {Entropy},
  year = {2024},
  volume = {26},
  number = {1},
  pages = {79},
  doi = {10.3390/e26010079}
}
Kostenlos starten →