Exact Expressions for Kullback–Leibler Divergence for Univariate Distributions
Entropy · 07.11.2024 · 26 (11) · 959
DOI: 10.3390/e26110959 ↗Kurz gefasst
Fachartikel in der Zeitschrift Entropy, online erschienen am 07.11.2024. Verfasst von Victor Nawa und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Mathematics and Statistics, University of Zambia, Lusaka 10101, Zambia. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The Kullback–Leibler divergence (KL divergence) is a statistical measure that quantifies the difference between two probability distributions. Specifically, it assesses the amount of information that is lost when one distribution is used to approximate another. This concept is crucial in various fields, including information theory, statistics, and machine learning, as it helps in understanding how well a model represents the underlying data. In a recent study by Nawa and Nadarajah, a comprehensive collection of exact expressions for the Kullback–Leibler divergence was derived for both multivariate and matrix-variate distributions. This work is significant as it expands on our existing knowledge of KL divergence by providing precise formulations for over sixty univariate distributions. The authors also ensured the accuracy of these expressions through numerical checks, which adds a layer of validation to their findings. The derived expressions incorporate various special functions, highlighting the mathematical complexity and richness of the topic. This research contributes to a deeper understanding of KL divergence and its applications in statistical analysis and modeling.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Mathematics and Statistics, University of Zambia, Lusaka 10101, Zambia.
- Department of Mathematics, University of Manchester, Manchester M13 9PL, UK.
ORCID-Profile: Victor Nawa
Zitieren
APA
Nawa, V., & Nadarajah, S. (2024). Exact Expressions for Kullback–Leibler Divergence for Univariate Distributions. Entropy, 26(11), 959. https://doi.org/10.3390/e26110959
Vancouver
Nawa V, Nadarajah S. Exact Expressions for Kullback–Leibler Divergence for Univariate Distributions. Entropy. 2024;26(11):959. doi:10.3390/e26110959
BibTeX
@article{Nawa2024,
author = {Nawa, Victor and Nadarajah, Saralees},
title = {Exact Expressions for Kullback–Leibler Divergence for Univariate Distributions},
journal = {Entropy},
year = {2024},
volume = {26},
number = {11},
pages = {959},
doi = {10.3390/e26110959}
}
EUVIMED