We consider the general problem of relative entropy minimization and entropy maximization subject to expectation constraints. We show that the solutions can be represented as members of an exponential family subject to weaker conditions than previously shown, and the representation can be simplified further if an appropriate conjugate prior density is used. As a result, the solutions can be fou...

The problem of image object extraction in the framework of rough sets and granular computing is addressed. A measure called ‘‘rough entropy of image’’ is defined based on the concept of image granules. Its maximization results in minimization of roughness in both object and background regions; thereby determining the threshold of partitioning. Methods of selecting the appropriate granule size a...

Ecosystem entropy production is predicted to increase along ecological succession and approach a state of maximum entropy production, but few studies have bridged the gap between theory and data. Here, we explore radiative entropy production in terrestrial ecosystems using measurements from 64 Free/Fair-Use sites in the FLUXNET database, including a successional chronosequence in the Duke Fores...

Clustering is an important unsupervised learning paradigm, but so far the traditional methodologies are mostly based on the minimization of the variance between the data and the cluster means. Here we propose a new evaluation function based on a recently developed information theoretic measure defined from Renyi’s entropy. We show how to apply Renyi’s entropy to clustering and analyze the resul...

In this paper, we describe a new approach to classification of text documents based on the minimization of system entropy, i.e., the overall uncertainty associated with the joint distribution of words and labels in the collection. The classification algorithm assigns a class label to a new document in such a way that its insertion into the system results in the maximum decrease (or least increa...

It is shown that in a stressed granular packing, the effect of the applied pressure and structural randomness on the contact force distribution can be described accurately by a variational principle of minimizing energy subject to the constraint of keeping entropy at a fixed value. The constraint on entropy may be regarded as a measure of the degree of retained disorderness in the system. This ...

A Distributed Denial of Service (DDOS) attack is a type of Internet attack that disrupts the normal function of the targeted computer network (server). This kind of attacks attempts to make target host resource unavailable to its legal users. Several efforts had made in detection and computation of the DDOS attacks over network, where IDS (Intrusion detection systems) are unable to isolate the ...

In the early 1990s, the state-of-the-art in commercial chromosome image acquisition was grayscale. Automated chromosome classification was based on the grayscale image and boundary information obtained during segmentation. Multi-spectral image acquisition was developed in 1990 and commercialized in the mid1990s. One acquisition method, multiplex fluorescence in-situ hybridization (M-FISH), uses...

The entropy calculation for radiation fluxes is reviewed and applied to simple radiation-surface interactions. A plate interacting with radiation from a hot object in the zenith of the hemisphere surrounded by a colder atmosphere is analyzed in detail. The entropy generation rate upon absorption and reflection of the incoming radiation is calculated and discussed. The plate is adiabatic in a fi...

We have previously proposed the quadratic Renyi's error entropy as an alternative cost function for supervised adaptive system training. An entropy criterion instructs the minimization of the average information content of the error signal rather than merely trying to minimize its energy. In this paper, we propose a generalization of the error entropy criterion that enables the use of any order...