Source Coding with Escort Distributions and Rényi Entropy Bounds

Abstract : We discuss the interest of escort distributions and Rényi entropy in the context of source coding. We first recall a source coding theorem by Campbell relating a generalized measure of length to the Rényi-Tsallis entropy. We show that the associated optimal codes can be obtained using considerations on escort-distributions. We propose a new family of measure of length involving escort-distributions and we show that these generalized lengths are also bounded below by the Rényi entropy. Furthermore, we obtain that the standard Shannon codes lengths are optimum for the new generalized lengths measures, whatever the entropic index. Finally, we show that there exists in this setting an interplay between standard and escort distributions.
Liste complète des métadonnées

https://hal-upec-upem.archives-ouvertes.fr/hal-00621945
Contributeur : Jean-François Bercher <>
Soumis le : mercredi 19 septembre 2012 - 14:39:36
Dernière modification le : mercredi 19 septembre 2012 - 16:10:54
Document(s) archivé(s) le : jeudi 20 décembre 2012 - 02:20:13

Fichier

RenyiCoding_finalArxiv.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Jean-François Bercher. Source Coding with Escort Distributions and Rényi Entropy Bounds. Physics Letters A, Elsevier, 2009, 373 (36), pp.3235-3238. <10.1016/j.physleta.2009.07.015>. <hal-00621945>

Partager

Métriques

Consultations de
la notice

227

Téléchargements du document

80