The measure-theoretic definition of Kullback-Leibler relative-entropy (or simply KLentropy) plays a basic role in defining various classical information measures on general spaces. Entropy, mutual information and conditional forms of entropy can be expressed in terms of KL-entropy and hence properties of their measure-theoretic analogs will follow from those of measure-theoretic KL-entropy. The...

In this article, we discuss the relationships between thermodynamic quantities and the spatial pattern in a reaction-diffusion model based on the reversible Gray-Scott model. This model is introduced for calculation of the entropy production in a reaction-diffusion system. First, we show the relationship between entropy production and pattern formation, and suggest that the entropy production c...

A class of non-equilibrium models for compressible multi-component fluids in multi-dimensions is investigated taking into account viscosity and heat conduction. These models are subject to the choice of interfacial pressures and interfacial velocity as well as relaxation terms for velocity, pressure, temperature and chemical potentials. Sufficient conditions are derived for these quantities tha...

We study Voiculescu’s microstate free entropy for a single non–selfadjoint random variable. The main result is that certain additional constraints on eigenvalues of microstates do not change the free entropy. Our tool is the method of random regularization of Brown measure which was studied recently by Haagerup and the author. As a simple application we present an upper bound for the free entro...

We study topological properties of quasi-particle states in the non-Abelian quantum Hall states. We apply a skein-theoretic method to the Read–Rezayi state whose effective theory is the SU(2)K Chern–Simons theory. As a generalization of the Pfaffian (K = 2) and the Fibonacci (K = 3) anyon states, we compute the braiding matrices of quasi-particle states with arbitrary spins. Furthermore we prop...

Two critical issues in microarray-based gene expression profiling with amplified RNA are its reliability and reproducibility compared to the non-amplified RNA. In this study, the non-linear relationship between the two methods was evaluated with the entropy in addition to the linear relationship using correlation coefficients. The correlation coefficients within the amplification method and bet...

Entanglement is the fundamental quantum property behind the now popular field of quantum transport of information. This quantum property is incompatible with the separation of a single system into two uncorrelated subsystems. Consequently, it does not require the use of an additive form of entropy. We discuss the problem of the choice of the most convenient entropy indicator, focusing our atten...

The year 2015 marked the 150th anniversary of “entropy” as a concept in classical thermodynamics. Despite its central role in the mathematical formulation of the Second Law and most of classical thermodynamics, its physical meaning continues to be elusive and confusing. This is especially true when we seek a reconstruction of the classical thermodynamics of a system from the statistical behavio...

We derive the entropy formula for the linear heat equation on general Riemannian manifolds and prove that it is monotone non-increasing on manifolds with nonnegative Ricci curvature. As applications, we study the relation between the value of entropy and the volume of balls of various scales. The results are simpler version, without Ricci flow, of Perelman’s recent results on volume non-collaps...

We introduce a ’quasi-topological‘ term [1] in D = 1 + 1 dimensions and the entropy for black holes is calculated [2]. The source of entropy in this case is justified by a non-null stress-energy tensor.