The Boltzmann–Gibbs and Tsallis entropies are essential concepts in statistical physics, which have found multiple applications in many engineering and science areas. In particular, we focus our interest on their applications to image processing through information theory. We present in this article a novel numeric method to calculate the Tsallis entropic index q characteristic to a given image...

We consider a small closed physical systems. It has xed energy and if the energy is a power of its generale coordinates then the distribution of any single coordinate will follow a distribution that maximizes Tsallis entropy. For many aspects of entropy can be discussed for such small systems with out going to the thermodynamical limit. By letting the number of degrees of freedom tend to in nit...

vet C ˜e — ™onvex set in — f—n—™h sp—™e —nd r ˜e — ril˜ert sp—™eF por —n oper—torE v—lued smooth fun™tion—l © X C 3 B@rAD we dene the Bregman divergence of x; y P C —s D © @x; yA Xa ©@xA ©@yA lim t3CH t I ©@y C t@x yAA ©@yA : ‚e™—ll th—t origin—lly vev fregm—n introdu™ed this ™on™ept for re—lEv—lued ™onvex fun™E tions © ‘P“F yn the selfE—djoint oper—torsD there is — st—nd—rd p—rti—l orderingD A...

As a novel data mining approach, a wavelet entropy algorithm is used to perform entropy statistics on wavelet coefficients (or reconstructed signals) at various wavelet scales on the basis of wavelet decomposition and entropy statistic theory. Shannon wavelet energy entropy, one kind of wavelet entropy algorithm, has been taken into consideration and utilized in many areas since it came into be...

The time operator and internal age are intrinsic features of entropy producing innovation processes. The innovation spaces at each stage are the eigenspaces of the time operator. The internal age is the average innovation time, analogous to lifetime computation. Time operators were originally introduced for quantum systems and highly unstable dynamical systems. Extending the time operator theor...

In statistical physics, Boltzmann-Shannon entropy provides good understanding for the equilibrium states of a number of phenomena. In statistics, the entropy corresponds to the maximum likelihood method, in which Kullback-Leibler divergence connects Boltzmann-Shannon entropy and the expected log-likelihood function. The maximum likelihood estimation has been supported for the optimal performanc...

We propose a generalized entropy maximization procedure, which takes into account the generalized averaging procedures and information gain definitions underlying the generalized entropies. This novel generalized procedure is then applied to Rényi and Tsallis entropies. The generalized entropy maximization procedure for Rényi entropies results in the exponential stationary distribution asymptot...

We present a first physical application of Tsallis’ generalized entropy to the thermodynamics of self-gravitating systems. The stellar system confined in a spherical cavity of radius re exhibits an instability, so-called gravothermal catastrophe, which has been originally investigated by Antonov (Vest.Leningrad Gros.Univ. 7 (1962) 135) and Lynden-Bell & Wood (Mon.Not.R.Astron.Soc. 138 (1968) 49...

The construction of efficient and effective decision trees remains a key topic in machine learning because of their simplicity and flexibility. A lot of heuristic algorithms have been proposed to construct near-optimal decision trees. Most of them, however, are greedy algorithms which have the drawback of obtaining only local optimums. Besides, common split criteria, e.g. Shannon entropy, Gain ...