Discrete normal distributions are defined as the with prescribed means and covariance matrices which maximize entropy on integer lattice support. The set of discrete form an exponential family cumulant function related to Riemann theta function. In this paper, we present several formula for common statistical divergences between including Kullback-Leibler divergence. particular, describe effici...

Images obtained from coherent illumination processes are contaminated with speckle. A prominent example of such imagery systems is the polarimetric synthetic aperture radar (PolSAR). For such remote sensing tool the speckle interference pattern appears in the form of a positive definite Hermitian matrix, which requires specialized models and makes change detection a hard task. The scaled comple...

We introduce a new blind source separation approach, based on modified Kullback– Leibler divergence between copula densities, for both independent and dependent source component signals. In the classical case of independent source components, the proposed method generalizes the mutual information (between probability densities) procedure. Moreover, it has the great advantage to be naturally ext...

We review a nonparametric version of Amari’s information geometry in which the set of positive probability densities on a given sample space is endowed with an atlas of charts to form a differentiable manifold modeled on Orlicz Banach spaces. This nonparametric setting is used to discuss the setting of typical problems in machine learning and statistical physics, such as black-box optimization,...

Learning visual concepts is an important tool for automatic annotation and visual querying of networked multimedia databases. It allows the user to express queries in his own vocabulary instead of the computer’s vocabulary. This paper gives an overview of our current research directions in learning visual concepts for use in our online visual webcrawler, ImageScape. We discuss using the Kullbac...

Interdependencies of stochastically interacting units are usually quantified by the Kullback-Leibler divergence of a stationary joint probability distribution on the set of all configurations from the corresponding factorized distribution. This is a spatial approach which does not describe the intrinsically temporal aspects of interaction. In the present paper, the setting is extended to a dyna...

[9] H. Nagaoka, \A generalization of the simultaneous diagonalization of hermitian matrices and its relation to quantum estimation theory," Trans. [12] H. Nagaoka, \On the relation Kullback divergence and Fisher information-from classical systems to quantum systems-," (1992)(in Japanese). reconstructuin and detection of quantum coherences on deierent observation levels", From the assumption, fo...

 In this paper, we discuss different estimators of the records Weibull distribution parameters and also we apply the Kullback-Leibler divergence of survival function method to estimate record Weibull parameters. Finally, these estimators have been compared using Monte Carlo simulation and suggested good estimators.