On the class of coding optimality of human languages and the origins of Zipf's law
Europhysics Letters · 01.09.2025 · 151 (6) · 62001
DOI: 10.1209/0295-5075/adfa3e ↗Kurz gefasst
Fachartikel in der Zeitschrift Europhysics Letters, online erschienen am 05.09.2025. Verfasst von Ramon Ferrer-i-Cancho. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: Universitat Politècnica de Catalunya.
Abstract (Originalsprache)
Here we present a new class of optimality for coding systems. Members of that class are displaced linearly from optimal coding and thus exhibit Zipf's law, namely a power-law distribution of frequency ranks. Within that class, Zipf's law, the size-rank law and the size-probability law form a group-like structure. We identify human languages that are members of the class. All languages showing sufficient agreement with Zipf's law are potential members of the class. In contrast, there are communication systems in other species that cannot be members of that class for exhibiting an exponential distribution instead but dolphins and humpback whales might. We provide a new insight into plots of frequency vs . rank in double logarithmic scale. For any system, a straight line in that scale indicates that the lengths of optimal codes under non-singular coding and under uniquely decodable encoding are displaced by a linear function whose slope is the exponent of Zipf's law. For systems under compression and constrained to be uniquely decodable, such a straight line may indicate that the system is coding close to optimality. We provide support for the hypothesis that Zipf's law originates from compression and define testable conditions for the emergence of Zipf's law in compressing systems.
Förderung
- Universitat Politècnica de Catalunya
Zitieren
APA
Ferrer-i-Cancho, R. (2025). On the class of coding optimality of human languages and the origins of Zipf's law. Europhysics Letters, 151(6), 62001. https://doi.org/10.1209/0295-5075/adfa3e
Vancouver
Ferrer-i-Cancho R. On the class of coding optimality of human languages and the origins of Zipf's law. Europhysics Letters. 2025;151(6):62001. doi:10.1209/0295-5075/adfa3e
BibTeX
@article{FerreriCancho2025,
author = {Ferrer-i-Cancho, Ramon},
title = {On the class of coding optimality of human languages and the origins of Zipf's law},
journal = {Europhysics Letters},
year = {2025},
volume = {151},
number = {6},
pages = {62001},
doi = {10.1209/0295-5075/adfa3e}
}
EUVIMED