EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Statistical-Physics Refinement of Soft Covering

Neri Merhav iD

Entropy · 08.06.2026 · 28 (6) · 647

DOI: 10.3390/e28060647 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 08.06.2026. Verfasst von Neri Merhav. Beteiligte Einrichtung: The Viterbi Faculty of Electrical and Computer Engineering, Technion-Israel Institute of Technology, Technion City, Haifa 3200003, Israel. Die Arbeit nennt 14 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We study the channel output distribution induced by a random code of rate R from the perspective of statistical physics. The central object is the partition function Zn(β|C)=∑yn[PYn|C(yn)]β, where yn is the channel output vector, C is the code, and β>0 plays the role of inverse temperature. More precisely, our focus is on the associated annealed free energy, ψ(β,R)=limn→∞1nlogE[Zn(β|C)], where the expectation is with respect to the randomness of C. This quantity encodes the full Rényi spectrum of the output distribution. The single-letter formula derived for the annealed free energy decomposes into two branches, which reflect a “competition” between two populations of codewords. One is the bulk branch, ψb(β,R), which is driven by typical codewords, and the other one is the sparse branchψs(β,R), which is driven by atypical codewords, where the qualifiers ‘typical’ and ‘atypical’ are in a sense that will become apparent later. We analyze the phase structure of each branch separately and characterize their competition. Both branches are derived for all β>0. The phase boundary R🟉(β), where the two branches are equal, is analyzed for β≥1, where it has an explicit closed-form expression. The phase diagram in the first quadrant of the (β,R) plane has four regions separated by three boundaries: R=Ib(β) (bulk branch transition), R=R🟉(β) (bulk–sparse competition boundary), and R=Is(β) (sparse branch transition), all meeting at the point (β,R)=(1,I(X;Y)), where I(X;Y) is the mutual information induced by the input type and the channel. Applications to guesswork, channel resolvability, and hypothesis testing are discussed, and all the results are illustrated with a numerical example of a Z-channel.

Schlagwörter

Stichwörter der Autor:innen

Rényi entropyannealed free energychannel resolvabilityfree energyguessworkhypothesis testingphase transitionsrandom codingsoft coveringstatistical mechanics

Autor:innen und Institutionen

  • The Viterbi Faculty of Electrical and Computer Engineering, Technion-Israel Institute of Technology, Technion City, Haifa 3200003, Israel.

ORCID-Profile: Neri Merhav

Zitieren

APA

Merhav, N. (2026). A Statistical-Physics Refinement of Soft Covering. Entropy, 28(6), 647. https://doi.org/10.3390/e28060647

Vancouver

Merhav N. A Statistical-Physics Refinement of Soft Covering. Entropy. 2026;28(6):647. doi:10.3390/e28060647

BibTeX
@article{Merhav2026,
  author = {Merhav, Neri},
  title = {A Statistical-Physics Refinement of Soft Covering},
  journal = {Entropy},
  year = {2026},
  volume = {28},
  number = {6},
  pages = {647},
  doi = {10.3390/e28060647}
}
Kostenlos starten →