Majorization and Rényi entropy inequalities via Sperner theory
نویسندگان
چکیده
منابع مشابه
Discrete Entropy Power Inequalities via Sperner Theory
A ranked poset is called strongly Sperner if the size of k-family cannot exceed the sum of k-largest Whitney numbers. In the sense of a function ordering, a function f is (weakly) majorized by g if the the sum of k-largest values in f cannot exceed the sum of k-largest values in g. Two definitions arise from different contexts, but they have strong similarities in their own meanings. Furthermor...
متن کاملOn Rényi entropy power inequalities
This paper is a follow-up of a recent work by Bobkov and Chistyakov, obtaining some improved Rényi entropy power inequalities (R-EPIs) for sums of independent random vectors. The first improvement relies on the same bounding techniques used in the former work, while the second significant improvement relies on additional interesting properties from matrix theory. The improvements obtained by th...
متن کاملRényi divergence and majorization
Rényi divergence is related to Rényi entropy much like information divergence (also called Kullback-Leibler divergence or relative entropy) is related to Shannon’s entropy, and comes up in many settings. It was introduced by Rényi as a measure of information that satisfies almost the same axioms as information divergence. We review the most important properties of Rényi divergence, including it...
متن کاملInequalities : Theory of majorization and its applications
insisting that the equality sign holds when k = n. Here, x[X] > • • • > x[n] are the xt arranged in decreasing order and, similarly, y[X] > • • • > y[n]. If (1) is only required for the increasing (decreasing) convex functions on R then one speaks of weak sub-majorization x >, respectively). The first is equivalent to (2). Let & be an open convex subset of R...
متن کاملTwo-moment inequalities for Rényi entropy and mutual information
This paper explores some applications of a twomoment inequality for the integral of the r-th power of a function, where 0 < r < 1. The first contribution is an upper bound on the Rényi entropy of a random vector in terms of the two different moments. When one of the moments is the zeroth moment, these bounds recover previous results based on maximum entropy distributions under a single moment c...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Discrete Mathematics
سال: 2019
ISSN: 0012-365X
DOI: 10.1016/j.disc.2019.03.002