Kullback–Leibler relative-entropy has unique properties in cases involving distributions resulting from relative-entropy minimization. Tsallis relative-entropy is a one-parameter generalization of Kullback–Leibler relative-entropy in the nonextensive thermostatistics. In this paper, we present the properties of Tsallis relative-entropy minimization and present some differences with the classica...

This study presents a measure-theoretic approach to estimate the upper bound on total variation of difference between hypergeometric and binomial distributions using Kullback-Leibler information divergence. The distribution can be used find probabilities associated with experiments. But if sample size is large relative population size, experiment may not binomial, good choice experiment. probab...

Exact inference in large and complex graphical models (e.g. Bayesian networks) is computationally intractable. Approximate schemes are therefore of great importance for real world computation. In this paper we consider a general scheme in which the original intractable graphical model is approximated by a model with a tractable structure. The approximating model is optimised by an iterative pro...