Generalization of the maximum entropy principle for curved statistical manifolds
نویسندگان
چکیده
The maximum entropy principle (MEP) is one of the most prominent methods to investigate and model complex systems. Despite its popularity, standard form MEP can only generate Boltzmann-Gibbs distributions, which are ill-suited for many scenarios interest. As a principled approach extend reach MEP, this paper revisits foundations in information geometry shows how curved statistical manifolds naturally leads generalization based on R\'enyi entropy. By establishing bridge between non-Euclidean our proposal sets solid foundation numerous applications entropy, enables range novel systems analysis.
منابع مشابه
Latent Maximum Entropy Principle for Statistical Language Modeling
In this paper, w dcscrihe a unified probabilistic framework for statistical lmiguage modeling, latent mmmum mtmpy Wnciple. The salient feature of this approach is that the hidden causal hierarchical dependency structure can be enc d e d into thpsiatwtical model in a principled way hy mixturts of expoocntial families with a rirh expressive power. We first show tlie problem lormulatiun, whition, ...
متن کاملThe Relevance of Maximum Entropy Production Principle and Maximum Information Entropy Principle in Biology
We start this talk posing the question, is there any physical principle that can serve as a selection principle in biology too? One of the first undertakings in this direction, conducted by Prigogine and Wiame [1] noticed correctly that biological processes are irreversible and as such should be described within irreversible thermodynamics. Since irreversible processes are characterized by entr...
متن کاملMaximum Entropy Principle for Quadratic Entropy of Uncertain Variables
In uncertainty theory, quadratic entropy is a type of entropy that provide a quantitative measurement of the uncertainty of uncertain variables. This paper presents the maximum entropy principle for quadratic entropy of uncertain variables, that is, out of all the uncertainty distributions satisfying given constraints, choose the maximum quadratic entropy one.
متن کاملMaximum Entropy Principle for Uncertain Variables
The concept of uncertain entropy is used to provide a quantitative measurement of the uncertainty associated with uncertain variables. After introducing the definition, this paper gives some examples of entropy of uncertain variables. Furthermore this paper proposes the maximum entropy principle for uncertain variables, that is, out of all the uncertainty distributions satisfying given constrai...
متن کاملNotions of the ergodic hierarchy for curved statistical manifolds
We present an extension of the ergodic, mixing, and Bernoulli levels of the ergodic hierarchy for statistical models on curved manifolds, making use of elements of the information geometry. This extension focuses on the notion of statistical independence between the microscopical variables of the system. Moreover, we establish an intimately relationship between statistical models and family of ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Physical review research
سال: 2021
ISSN: ['2643-1564']
DOI: https://doi.org/10.1103/physrevresearch.3.033216