A Semantic Generalization of Shannon’s Information Theory and Applications
Entropy · 24.04.2025 · 27 (5) · 461
DOI: 10.3390/e27050461 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Entropy, online erschienen am 24.04.2025. Verfasst von Chenguang Lu. Beteiligte Einrichtung: Intelligence Engineering and Mathematics Institute, Liaoning Technical University, Fuxin 123000, China. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 101 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Does semantic communication require a semantic information theory parallel to Shannon’s information theory, or can Shannon’s work be generalized for semantic communication? This paper advocates for the latter and introduces a semantic generalization of Shannon’s information theory (G theory for short). The core idea is to replace the distortion constraint with the semantic constraint, achieved by utilizing a set of truth functions as a semantic channel. These truth functions enable the expressions of semantic distortion, semantic information measures, and semantic information loss. Notably, the maximum semantic information criterion is equivalent to the maximum likelihood criterion and similar to the Regularized Least Squares criterion. This paper shows G theory’s applications to daily and electronic semantic communication, machine learning, constraint control, Bayesian confirmation, portfolio theory, and information value. The improvements in machine learning methods involve multi-label learning and classification, maximum mutual information classification, mixture models, and solving latent variables. Furthermore, insights from statistical physics are discussed: Shannon information is similar to free energy; semantic information to free energy in local equilibrium systems; and information efficiency to the efficiency of free energy in performing work. The paper also proposes refining Friston’s minimum free energy principle into the maximum information efficiency principle. Lastly, it compares G theory with other semantic information theories and discusses its limitation in representing the semantics of complex data.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Intelligence Engineering and Mathematics Institute, Liaoning Technical University, Fuxin 123000, China.
- School of Computer Engineering and Applied Mathematics, Changsha University, Changsha 410022, China.
ORCID-Profile: Chenguang Lu
Zitieren
APA
Lu, C. (2025). A Semantic Generalization of Shannon’s Information Theory and Applications. Entropy, 27(5), 461. https://doi.org/10.3390/e27050461
Vancouver
Lu C. A Semantic Generalization of Shannon’s Information Theory and Applications. Entropy. 2025;27(5):461. doi:10.3390/e27050461
BibTeX
@article{Lu2025,
author = {Lu, Chenguang},
title = {A Semantic Generalization of Shannon’s Information Theory and Applications},
journal = {Entropy},
year = {2025},
volume = {27},
number = {5},
pages = {461},
doi = {10.3390/e27050461}
}
EUVIMED