A theory to predict the steady-state position of a dissipative flow-controlled system, as defined by a control volume, is developed based on the maximum entropy principle of Jaynes, involving minimization of a generalized free-energy-like potential. The analysis provides a theoretical justification of a local, conditional form of the maximum entropy production principle, which successfully pred...

Improving the efficiency and convergence rate of the Multilayer Backpropagation Neural Network Algorithms is an important area of research. The last researches have witnessed an increasing attention to entropy based criteria in adaptive systems. Several principles were proposed based on the maximization or minimization of cross entropy function. One way of entropy criteria in learning systems i...

Entropy functionals (i.e. convex integral functionals) and extensions of these functionals are minimized on convex sets. This paper is aimed at reducing as much as possible the assumptions on the constraint set. Dual equalities and characterizations of the minimizers are obtained with weak constraint qualifications.

The error-entropy-minimization approach in adaptive system training is addressed in this paper. The effect of Parzen windowing on the location of the global minimum of entropy has been investigated. An analytical proof that shows the global minimum of the entropy is a local minimum, possibly the global minimum, of the nonparametrically estimated entropy using Parzen windowing with Gaussian kern...

We propose a framework for learning hiddenvariable models by optimizing entropies, in which entropy minimization, posterior maximization, and free energy minimization are all equivalent. Solutions for the maximum a posteriori (MAP) estimator yield powerful learning algorithms that combine all the charms of expectation-maximization and deterministic annealing. Contained as special cases are the ...

It is often assumed that maximization of the statistical entropy cannot account for the spontaneous emergence of currents or compositional heterogeneity associated with them, and that other principles involving entropy production (its maximization or minimization) must be invoked to explain the emergence and robustness of the order in driven dissipative systems. I show for a class of simple mod...