Reconsideration of Information-Theoretic Principles—Perspective from the Dual Probability Distribution
Entropy · 12.06.2026 · 28 (6) · 681
DOI: 10.3390/e28060681 ↗Kurz gefasst
Fachartikel in der Zeitschrift Entropy, online erschienen am 12.06.2026. Verfasst von Yoshikazu Ohtaki und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Mathematics and Informatics, Ibaraki University, Mito 310-8512, Japan. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 16 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science.
Abstract (Originalsprache)
We reconsider information-theoretic principles, such as the maximum entropy principle/minimum Massieu potential principle, from the perspective of the dual probability distribution. This is introduced through Sanov’s Lemma for the multinomial distribution. The dual correspondence becomes asymptotically manifest. The Massieu potential is rewritten as the Kullback–Leibler divergence between the dual probability distribution and the dual reference distribution. Similarly, the dual potential is rewritten as the cumulant generating function with respect to the dual reference distribution. This perspective gives us new insight into information-theoretic principles. As the dual probability distribution naturally arises in data sampling, we anticipate that this new perspective will play a significant role in data analysis.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Mathematics and Informatics, Ibaraki University, Mito 310-8512, Japan.
- Region of Electrical and Electronic Systems Engineering, Ibaraki University, Hitachi 316-8511, Japan.
ORCID-Profile: Yoshikazu Ohtaki, Tomomi Nakamura, Tatsuaki Wada
Förderung
- Japan Society for the Promotion of Science
Zitieren
APA
Ohtaki, Y., Nakamura, T., Hasegawa, H. H., & Wada, T. (2026). Reconsideration of Information-Theoretic Principles—Perspective from the Dual Probability Distribution. Entropy, 28(6), 681. https://doi.org/10.3390/e28060681
Vancouver
Ohtaki Y, Nakamura T, Hasegawa HH, Wada T. Reconsideration of Information-Theoretic Principles—Perspective from the Dual Probability Distribution. Entropy. 2026;28(6):681. doi:10.3390/e28060681
BibTeX
@article{Ohtaki2026,
author = {Ohtaki, Yoshikazu and Nakamura, Tomomi and Hasegawa, Hiroshi-H and Wada, Tatsuaki},
title = {Reconsideration of Information-Theoretic Principles—Perspective from the Dual Probability Distribution},
journal = {Entropy},
year = {2026},
volume = {28},
number = {6},
pages = {681},
doi = {10.3390/e28060681}
}
EUVIMED