Information, Entropy, and the Zeta Function
IPI Letters · 2024
DOI: 10.59973/ipil.128 ↗At a glance
Journal article in IPI Letters, 2024. Written by Barry Robson. 16 references. The full text is freely available (open access, CC BY 4.0).
Abstract (original language)
The relation between the entropy (in thermodynamics) of Boltzmann and of Shannon information (in communication), has recently been discussed by Vopson (e.g. Refs [1,2]). Amongst several interesting similarities and di ff erences pointed out by Vopson, one is that writing information to a computational device increases entropy. This assertion appears counterin-tuitive because entropy is often described as negative information. Nonetheless, it appears much more natural when expressed in terms of a definition of information proposed by the present author BR. There are, of course, other kinds of information, e.g., Kullback-Leibler, Fano mutual, and Chaitin information [3]. These lie closer to the author’s approach discussed below, but there are fundamental di ff erences. Some have been touched upon by others (e.g., Refs [4-6]), but these are relatively recent and lack aspects important to the present discussion. The original publications [7-9] were the consequences of a student project given to the present author, namely, to assess what information about three-dimensional structures of proteins were conveyed in their amino acid sequences when data was extremely limited. As data became more plentiful, a Theory of Expected information emerged that could also be applied more generally [10]. As a predictive method, it resembles but preempted the Bayes Net [11]. The relevance to the relationship between information and entropy is clearer in later applications that included the analysis of biomedical data, given as large spreadsheet [12-15]. One wished to address the information required to write and (primarily) extract information as knowledge from a spreadsheet, e.g. each record (row) is a
Cite
APA
Robson, B. (2024). Information, Entropy, and the Zeta Function. IPI Letters. https://doi.org/10.59973/ipil.128
Vancouver
Robson B. Information, Entropy, and the Zeta Function. IPI Letters. 2024. doi:10.59973/ipil.128
BibTeX
@article{Robson2024,
author = {Robson, Barry},
title = {Information, Entropy, and the Zeta Function},
journal = {IPI Letters},
year = {2024},
doi = {10.59973/ipil.128}
}
EUVIMED