EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Exact Expressions for Kullback–Leibler Divergence for Univariate Distributions

Victor Nawa iD, Saralees Nadarajah

Entropy · 07.11.2024 · 26 (11) · 959

DOI: 10.3390/e26110959 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 07.11.2024. Verfasst von Victor Nawa und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Mathematics and Statistics, University of Zambia, Lusaka 10101, Zambia. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The Kullback–Leibler divergence (KL divergence) is a statistical measure that quantifies the difference between two probability distributions. Specifically, it assesses the amount of information that is lost when one distribution is used to approximate another. This concept is crucial in various fields, including information theory, statistics, and machine learning, as it helps in understanding how well a model represents the underlying data. In a recent study by Nawa and Nadarajah, a comprehensive collection of exact expressions for the Kullback–Leibler divergence was derived for both multivariate and matrix-variate distributions. This work is significant as it expands on our existing knowledge of KL divergence by providing precise formulations for over sixty univariate distributions. The authors also ensured the accuracy of these expressions through numerical checks, which adds a layer of validation to their findings. The derived expressions incorporate various special functions, highlighting the mathematical complexity and richness of the topic. This research contributes to a deeper understanding of KL divergence and its applications in statistical analysis and modeling.

Schlagwörter

Stichwörter der Autor:innen

Bessel functionGauss hypergeometric functionbeta functionconfluent hypergeometric functiongamma function

Autor:innen und Institutionen

  • Department of Mathematics and Statistics, University of Zambia, Lusaka 10101, Zambia.
  • Department of Mathematics, University of Manchester, Manchester M13 9PL, UK.

ORCID-Profile: Victor Nawa

Zitieren

APA

Nawa, V., & Nadarajah, S. (2024). Exact Expressions for Kullback–Leibler Divergence for Univariate Distributions. Entropy, 26(11), 959. https://doi.org/10.3390/e26110959

Vancouver

Nawa V, Nadarajah S. Exact Expressions for Kullback–Leibler Divergence for Univariate Distributions. Entropy. 2024;26(11):959. doi:10.3390/e26110959

BibTeX
@article{Nawa2024,
  author = {Nawa, Victor and Nadarajah, Saralees},
  title = {Exact Expressions for Kullback–Leibler Divergence for Univariate Distributions},
  journal = {Entropy},
  year = {2024},
  volume = {26},
  number = {11},
  pages = {959},
  doi = {10.3390/e26110959}
}
Kostenlos starten →