Content-based video retrieval systems have shown great potential in supporting decision making in clinical activities, teaching, and biological research. In content-based video retrieval, feature combination plays a key role. As a result content-based retrieval of all different type video data turns out to be a challenging and vigorous problem. This paper presents an effective content based vid...

Berry–Esseen-type bounds for total variation and relative entropy distances to the normal law are established for the sums of non-i.i.d. random variables.

We have developed a method for quantifying neural response changes in terms of the Kullback-Leibler distance between the intensity functions for each stimulus condition. We use empirical histogram estimates to characterize the intensity function of the neural response. A critical factor in determining the histogram estimates is selection of binwidth. In this work we analytically derive the Kull...

One of important components in an image retrieval system is selecting a distance measure to compute rank between two objects. In this paper, several distance measures were researched to implement a foliage plant retrieval system. Sixty kinds of foliage plants with various leaf color and shape were used to test the performance of 7 different kinds of distance measures: city block distance, Eucli...

The cross-entropy and minimum cross-entropy methods are well-known Monte Carlo simulation techniques for rare-event probability estimation and optimization. In this paper we investigate how these methods can be extended to provide a general non-parametric cross-entropy framework based on φ-divergence distance measures. We show how the χ distance in particular yields a viable alternative to Kull...

In music similarity and in the related task of genre classification, a distance measure between Gaussian mixture models is frequently needed. We present a comparison of the KullbackLeibler distance, the earth movers distance and the normalized L2 distance for this application. Although the normalized L2 distance was slightly inferior to the Kullback-Leibler distance with respect to classificati...

The focus of this work is on using texture information for searching, browsing and retrieving images from a large database. In the wavelet approaches, texture is characterized by its energy distribution in the decomposed subbands. However it is unclear on how to define similarity functions on extracted features; usually simple norm-based distances together with heuristic normalization are emplo...

In this paper, we propose a multi-modal image registration method based on the a priori knowledge of the expected joint intensity distribution estimated from aligned training images. The goal of the registration is to find the optimal transformation such that the discrepancy between the expected and the observed joint intensity distributions is minimised. The difference between distributions is...

This report contains a list of some of the more prominent properties and theorems concerning the Kullback-Leibler (KL) discrimination distance. A brief discussion is also provided indicating the type of problems in which the KL distance has been applied. References are provided for the reader’s convenience. 1 Definition For two continuous density functions f1(x), f2(x) the Kullback-Leibler (KL)...