In this paper, we present a maximum entropy (maxent) approach to the fusion of experts opinions, or classifiers outputs, problem. The maxent approach is quite versatile and allows us to express in a clear, rigorous, way the a priori knowledge that is available on the problem. For instance, our knowledge about the reliability of the experts and the correlations between these experts can be easil...

It has been shown previously that a Maximum Entropy model can be used to learn the correct weights on linguistic constraints in the supervised case [4]. In this paper, we show how to extend the existing work to learn underlying forms in addition to linguistic constraints, discussing the practical details of the priors and the constraint sets that allow this to work. In addition, we discuss a te...

The following picture shows the test omission rate and predicted area as a function of the cumulative threshold, averaged over the replicate runs. The omission rate should be close to the predicted omission, because of the definition of the cumulative threshold. The next picture is the receiver operating characteristic (ROC) curve for the same data, again averaged over the replicate runs. Note ...

The principle of maximum entropy has recently been applied to several problems of condensed matter theory. In this paper we discuss some technical aspects of the maxent approach to these problems, and show some general properties of the applications of the method. In particular, we show that maxent can be thought of as a convenient way to close hierarchies, and to extrapolate perturbation serie...

Maximum Entropy (MaxEnt) language models are powerful models that can incorporate linguistic and non-linguistic contextual signals in a unified framework with a convex loss. MaxEnt models also have the advantage of scaling to large model and training data sizes We present the following two contributions to MaxEnt training: (1) By leveraging smaller amounts of transcribed data, we demonstrate th...

Maximum entropy inverse optimal control (MaxEnt IOC) is an effective means of discovering the underlying cost function of demonstrated human activity and can be used to predict human behavior over low-dimensional state spaces (i.e., forecasting of 2D trajectories). To enable inference in very large state spaces, we introduce an approximate MaxEnt IOC procedure to address the fundamental computa...

The variational principles called maximum entropy (MaxEnt) and maximum caliber (MaxCal) are reviewed. MaxEnt originated in the statistical physics of Boltzmann and Gibbs, as a theoretical tool for predicting the equilibrium states of thermal systems. Later, entropy maximization was also applied to matters of information, signal transmission, and image reconstruction. Recently, since the work of...

Background: Climate warming has caused substantial changes in temporal and spatial environmental patterns. The study on hot spots of rare endangered plants Northwest China under predicted climate change can provide a scientific reference for the restoration reconstruction those degraded habitats, as well improvement protection system China. Results: Based MaxEnt algorithm, 813 effective distrib...

MaxEnt grammar is a probabilistic version of Harmonic Grammar in which the harmony scores candidates are mapped onto probabilities. It has become tool choice for analyzing phonological phenomena involving variation or gradient acceptability, but there competing proposal making probabilistic, Noisy Grammar, derived by adding random ‘noise’ to constraint weights. In this paper these frameworks, a...