An approach to the Shannon and Rényi entropy maximization problems with constraints on the mean and law invariant deviation measure for a random variable has been developed. The approach is based on the representation of law invariant deviation measures through corresponding convex compact sets of nonnegative concave functions. A solution to the problem has been shown to have an alpha-concave d...

Distributions of abundances or frequencies play an important role in many fields of science, from biology to sociology, as does the Rényi entropy, which measures the diversity of a statistical ensemble. We derive a mathematical relation between the abundance distribution and the Rényi entropy, by analogy with the equivalence of ensembles in thermodynamics. The abundance distribution is mapped o...

One may need to build a statistical parser for a new language, using only a very small labeled treebank together with raw text. We argue that bootstrapping a parser is most promising when the model uses a rich set of redundant features, as in recent models for scoring dependency parses (McDonald et al., 2005). Drawing on Abney’s (2004) analysis of the Yarowsky algorithm, we perform bootstrappin...

The purpose of this study is to define the concepts of Tsallis entropy and conditional Tsallis entropy of fuzzy partitions and to obtain some results concerning this kind entropy. We show that the Tsallis entropy of fuzzy partitions has the subadditivity and concavity properties. We study this information measure under the refinement and zero mode subset relations. We check the chain rules for ...

Abstract In this paper, we introduce the newly generated Ristić–Balakrishnan–Topp–Leone–Gompertz-G family of distributions. Statistical and mathematical properties new including moments, moment generating function, incomplete conditional probability weighted distribution order statistics, stochastic ordering, Rényi entropy are derived. The unknown parameters inferred using maximum likelihood es...

The classical entropy power inequality is extended to the Rényi entropy. We also discuss the question of the existence of the entropy for sums of independent random variables.

We investigate the large-time asymptotics of nonlinear diffusion equations ut = ∆u p in dimension n ≥ 1, in the exponent interval p > n/(n+ 2), when the initial datum u0 is of bounded second moment. Precise rates of convergence to the Barenblatt profile in terms of the relative Rényi entropy are demonstrated for finite-mass solutions defined in the whole space when they are re-normalized at eac...

Landsberg’s notion of disorder, entropy normalized to maximum entropy, was originally proposed for the Shannon information-theoretic entropy to overcome deficiencies of entropy as a measure of disorder due to extensivity. We generalize Landsberg’s concept to three classes of extended entropies: Rényi, Tsallis and Landsberg-Vedral. Three examples are treated, including one based on the logistic ...