In blind source separation, two different separation techniques are mainly used: Minimal Mutual Information (MMI), where minimization of the mutual output information yields an independent random vector, and Maximum Entropy (ME), where the output entropy is maximized. However, it is yet unclear why ME should solve the separation problem, ie. result in an independent vector. Amari has given a pa...

In blind source separation (BSS), two di.erent separation techniques are mainly used: minimal mutual information (MMI), where minimization of the mutual output information yields an independent random vector, and maximum entropy (ME), where the output entropy is maximized. However, it is yet unclear why ME should solve the separation problem, i.e. result in an independent vector. Yang and Amari...

This paper describes our system for the task of extracting frame semantic structures in SemEval–2007. The system architecture uses two types of learning models in each part of the task: Support Vector Machines (SVM) and Maximum Entropy (ME). Designed as a pipeline of classifiers, the semantic parsing system obtained competitive precision scores on the test data.

Is Maximum Entropy Production (MEP) a physical principle? In this paper I tentatively suggest it is not, on the basis that MEP is equivalent to Jaynes’ Maximum Entropy (MaxEnt) inference algorithm that passively translates physical assumptions into macroscopic predictions, as applied to non-equilibrium systems. MaxEnt itself has no physical content; disagreement between MaxEnt predictions and e...

This paper revisits the problem of traffic generation from first principles: rather than following up on previous work of providing an explanatory model for why observed traffic matrices look the way they do, this paper generates TM instances subject to user specified spatial and temporal constraints. The authors hereby rely on the Maximum Entropy (MaxEnt) framework. Maximum Entropy is a powerf...

It is well-known that maximum entropy distributions, subject to appropriate moment constraints, arise in physics and mathematics. In an attempt to find a physical reason for the appearance of maximum entropy distributions, the following theorem is offered. The conditional distribution of X, given the empirical observation (1 /n)X:, ,/I ( X,) = (Y, where X, , X2, . are independent identically di...

Hausdor€ moment problem in the approach of maximum entropy is reconsidered. Some aspects, as existence condition, entropy convergence, entropy decreasing, stability are studied through a uni®ed approach. Results known in literature and some new ones are illustrated Ó 1999 Elsevier Science Inc. All rights reserved. Keywords: Convex hull; Entropy; Hankel determinant; Moment problem 1. Introductio...

A generalisation of the maximum entropy (me) approach to default reasoning 7,8] to cater for variable strength defaults is presented. The assumptions on which the original work was based are reviewed and revised. A new algorithm is presented that is shown to compute the me-ranking under these more general conditions. The limitations of the revised approach are discussed and a test for the uniqu...