Numerous entropy-type characteristics (functionals) generalizing Rényi entropy are widely used in mathematical statistics, physics, information theory, and signal processing for characterizing uncertainty in probability distributions and distribution identification problems. We consider estimators of some entropy (integral) functionals for discrete and continuous distributions based on the numb...

Using Rényi entropy, an alternative statistics to Tsallis one for nonextensive systems at equilibrium is discussed. We show that it is possible to have the q-exponential distribution function for equilibrium nonextensive systems having nonadditive energy but additive entropy. PACS : 02.50.-r, 05.20.-y, 05.70.-a

The entropies of Shannon, Rényi and Kolmogorov are analyzed and compared together with their main properties. The entropy of some particular antennas with a pre-fractal shape, also called fractal antennas, is studied. In particular, their entropy is linked with the fractal geometrical shape and the physical performance.

An extension of the entropy power inequality to the form N r (X +Y ) ≥ N r (X) +N r (Y ) with arbitrary independent summands X and Y in R is obtained for the Rényi entropy and powers α ≥ (r + 1)/2.

A classical upper bound for quantum entropy is identified and illustrated, 0 ≤ Sq ≤ ln(eσ2/ 2~), involving the variance σ2 in phase space of the classical limit distribution of a given system. A fortiori, this further bounds the corresponding information-theoretical generalizations of the quantum entropy proposed by Rényi.

Following ref [1], a classical upper bound for quantum entropy is identified and illustrated, 0 ≤ Sq ≤ ln(eσ/ 2~), involving the variance σ in phase space of the classical limit distribution of a given system. A fortiori, this further bounds the corresponding information-theoretical generalizations of the quantum entropy proposed by Rényi.

Using Rényi entropy, an alternative statistics to Tsallis one for nonextensive systems at equilibrium is discussed. We show that it is possible to have the q-exponential distribution function for equilibrium nonextensive systems having nonadditive energy but additive entropy. PACS : 02.50.-r, 05.20.-y, 05.70.-a

Using Rényi entropy, an alternative statistics to Tsallis one for nonextensive systems at equilibrium is discussed. We show that it is possible to have the q-exponential distribution function for equilibrium nonextensive systems having nonadditive energy but additive entropy. PACS : 02.50.-r, 05.20.-y, 05.30.-d,05.70.-a

We study a generalized version of Wyner’s common information problem (also coined the distributed sources simulation problem). The original common information problem consists in understanding the minimum rate of the common input to independent processors to generate an approximation of a joint distribution when the distance measure used to quantify the discrepancy between the synthesized and t...

Kullback-Leibler relative-entropy or KL-entropy of P with respect to R defined as ∫ X ln dP dR dP , where P and R are probability measures on a measurable space (X,M), plays a basic role in the definitions of classical information measures. It overcomes a shortcoming of Shannon entropy – discrete case definition of which cannot be extended to nondiscrete case naturally. Further, entropy and oth...