EUVIMEDEUVIMED entdecken
Crossref

Information Theory and Statistics: A Tutorial

I. Csiszár, P. C. Shields

Foundations and Trends® in Communications and Information Theory · 2004

DOI: 10.1561/0100000004 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Foundations and Trends® in Communications and Information Theory, 2004. Verfasst von I. Csiszár und 1 weiteren Autor:innen. Die Arbeit wurde bisher 378-mal zitiert (Crossref) und nennt 51 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This tutorial is concerned with applications of information theory concepts in statistics, in the finite alphabet setting. The information measure known as information divergence or Kullback-Leibler distance or relative entropy plays a key role, often with a geometric flavor as an analogue of squared Euclidean distance, as in the concepts of I-projection, I-radius and I-centroid. The topics covered include large deviations, hypothesis testing, maximum likelihood estimation in exponential families, analysis of contingency tables, and iterative algorithms with an “information geometry” background. Also, an introduction is provided to the theory of universal coding, and to statistical inference via the minimum description length principle motivated by that theory.

Zitieren

APA

Csiszár, I., & Shields, P. C. (2004). Information Theory and Statistics: A Tutorial. Foundations and Trends® in Communications and Information Theory. https://doi.org/10.1561/0100000004

Vancouver

Csiszár I, Shields PC. Information Theory and Statistics: A Tutorial. Foundations and Trends® in Communications and Information Theory. 2004. doi:10.1561/0100000004

BibTeX
@article{Csiszr2004,
  author = {Csiszár, I. and Shields, P. C.},
  title = {Information Theory and Statistics: A Tutorial},
  journal = {Foundations and Trends® in Communications and Information Theory},
  year = {2004},
  doi = {10.1561/0100000004}
}
Kostenlos starten →