Erasure entropies and Gibbs measures
نویسندگان
چکیده
Recently Verdù and Weissman introduced erasure entropies, which are meant to measure the information carried by one or more symbols given all of the remaining symbols in the realization of a random process or field. A natural relation to Gibbs measures has also been observed. In this short note we study this relation further, review a few earlier contributions from statistical mechanics, and provide the formula for the erasure entropy of a Gibbs measure in terms of the corresponding potential. For some 2dimensional Ising models, for which Verdú and Weissman suggested a numerical proedure, we show how to obtain an exact formula for the erasure entropy.
منابع مشابه
Differential entropy and time
We give a detailed analysis of the Gibbs-type entropy notion and its dynamical behavior in case of time-dependent continuous probability distributions of varied origins: related to classical and quantum systems. The purpose-dependent usage of conditional Kullback-Leibler and Gibbs (Shannon) entropies is explained in case of non-equilibrium Smoluchowski processes. A very different temporal behav...
متن کاملFiber-Mixing Codes between Shifts of Finite Type and Factors of Gibbs Measures
A sliding block code π : X → Y between shift spaces is called fiber-mixing if, for every x and x′ in X with y = π(x) = π(x′), there is z ∈ π−1(y) which is left asymptotic to x and right asymptotic to x′. A fiber-mixing factor code from a shift of finite type is a code of class degree 1 for which each point of Y has exactly one transition class. Given an infinite-to-one factor code between mixin...
متن کاملThermodynamic measures of cancer: Gibbs free energy and entropy of protein-protein interactions.
Thermodynamics is an important driving factor for chemical processes and for life. Earlier work has shown that each cancer has its own molecular signaling network that supports its life cycle and that different cancers have different thermodynamic entropies characterizing their signaling networks. The respective thermodynamic entropies correlate with 5-year survival for each cancer. We now show...
متن کاملThermodynamic formalism and large deviations for multiplication-invariant potentials on lattice spin systems
We introduce the multiplicative Ising model and prove basic properties of its thermodynamic formalism such as existence of pressure and entropies. We generalize to one-dimensional “layer-unique” Gibbs measures for which the same results can be obtained. For more general models associated to a d-dimensional multiplicative invariant potential, we prove a large deviation theorem in the uniqueness ...
متن کاملBoltzmann-gibbs Entropy: Axiomatic Characterization and Application
Wepresent axiomatic characterizations of both Boltzmann andGibbs entropies together with an application.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1001.3122 شماره
صفحات -
تاریخ انتشار 2010