An information - theoretic proof of Hadamard's inequality
نویسندگان
چکیده
only linearly and not exponentially with the source block length. Since a trellis approaches a tree as the constraint length grows large, this work also suggests an alternate tree coding scheme and proof of the tree coding theorem of Jakatdar and Pearlman [6]. APPENDIX A The generalized Gallager function Edk(p) is defined in (21). In the following we prove that given RN,* > RN-*(De) for allj and k; or equivalently given (7a), that the per-letfer " rate " associated with each code letter being always greater than the rate r,(d,) induced by the rate-distortion function of the corresponding source letter u,, will imply (22a), that is Ep I 1-R P '0, foralljandkand-lO-1 < p < 0, for r > r,(dO) (28) where E,(p) and r,(do) are respectively the Gallager function and the rate-distortion function associated with the letter u,. We will use the property (28) to establish (27) as follows:
منابع مشابه
A simple proof of the Ahlswede - Csiszár one-bit theorem
1983 931 from the second, let K = AA'. Then AA' is nonnegative definite and IAl*=+4'I < jy&L4'),i = n(l&z:.). (1) i j The implication of the second inequality from the first follows from the fact that every nonnegative definite matrix K can be factored as K = AA'. A typical proof of Hadamard's inequality is by induction (see, for example, Bellman [l]) and involves a determinant decomposition fo...
متن کاملHermite-Hadamard's type inequalities for operator convex functions
Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Abstract In this paper, we give a simple proof and a new generalization of the Hermite-Hadamard inequality for operator convex functions.
متن کاملAn information-theoretic proof of Nash's inequality
We show that an information-theoretic property of Shannon's entropy power, known as concavity of entropy power [7], can be fruitfully employed to prove inequalities in sharp form. In particular, the concavity of entropy power implies the logarithmic Sobolev inequality, and the Nash's inequality with the sharp constant.
متن کاملExtracting analytic proofs from numerically solved Shannon-type Inequalities
A class of information inequalities, called Shannon-type inequalities (STIs), can be proven via a computer software called ITIP [1]. In previous work [2], we have shown how this technique can be utilized to Fourier-Motzkin elimination algorithm for Information Theoretic Inequalities. Here, we provide an algorithm for extracting analytic proofs of information inequalities. Shannon-type inequalit...
متن کاملInformation Theoretic Approach to Geometric Programming
This paper shows how the fundamental geometric inequality lemma of geometric programming can be obtained immediately from information theoretic methods. This results in a drastic simplification of the proof and points the way to other connections between information theory and geometric programming
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- IEEE Trans. Information Theory
دوره 29 شماره
صفحات -
تاریخ انتشار 1983