An information - theoretic proof of Hadamard's inequality

نویسندگان

  • Thomas M. Cover
  • Abbas El Gamal
چکیده

only linearly and not exponentially with the source block length. Since a trellis approaches a tree as the constraint length grows large, this work also suggests an alternate tree coding scheme and proof of the tree coding theorem of Jakatdar and Pearlman [6]. APPENDIX A The generalized Gallager function Edk(p) is defined in (21). In the following we prove that given RN,* > RN-*(De) for allj and k; or equivalently given (7a), that the per-letfer " rate " associated with each code letter being always greater than the rate r,(d,) induced by the rate-distortion function of the corresponding source letter u,, will imply (22a), that is Ep I 1-R P '0, foralljandkand-lO-1 < p < 0, for r > r,(dO) (28) where E,(p) and r,(do) are respectively the Gallager function and the rate-distortion function associated with the letter u,. We will use the property (28) to establish (27) as follows:

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A simple proof of the Ahlswede - Csiszár one-bit theorem

1983 931 from the second, let K = AA'. Then AA' is nonnegative definite and IAl*=+4'I < jy&L4'),i = n(l&z:.). (1) i j The implication of the second inequality from the first follows from the fact that every nonnegative definite matrix K can be factored as K = AA'. A typical proof of Hadamard's inequality is by induction (see, for example, Bellman [l]) and involves a determinant decomposition fo...

متن کامل

Hermite-Hadamard's type inequalities for operator convex functions

Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. Abstract In this paper, we give a simple proof and a new generalization of the Hermite-Hadamard inequality for operator convex functions.

متن کامل

An information-theoretic proof of Nash's inequality

We show that an information-theoretic property of Shannon's entropy power, known as concavity of entropy power [7], can be fruitfully employed to prove inequalities in sharp form. In particular, the concavity of entropy power implies the logarithmic Sobolev inequality, and the Nash's inequality with the sharp constant.

متن کامل

Extracting analytic proofs from numerically solved Shannon-type Inequalities

A class of information inequalities, called Shannon-type inequalities (STIs), can be proven via a computer software called ITIP [1]. In previous work [2], we have shown how this technique can be utilized to Fourier-Motzkin elimination algorithm for Information Theoretic Inequalities. Here, we provide an algorithm for extracting analytic proofs of information inequalities. Shannon-type inequalit...

متن کامل

Information Theoretic Approach to Geometric Programming

This paper shows how the fundamental geometric inequality lemma of geometric programming can be obtained immediately from information theoretic methods. This results in a drastic simplification of the proof and points the way to other connections between information theory and geometric programming

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • IEEE Trans. Information Theory

دوره 29  شماره 

صفحات  -

تاریخ انتشار 1983