We show that the derivative of the relative entropy with respect to its parameters is lower and upper bounded. We characterize the conditions under which this derivative can reach zero. We use these results to explain when the minimum relative entropy and the maximum log likelihood approaches can be valid. We show that these approaches naturally activate in the presence of large data sets and t...

My greatest concern was what to call it. I thought of calling it “information”, but the word was overly used, so I decided to call it “uncertainty”. When I discussed it with John von Neumann, he had a better idea. Von Neumann told me, “You should call it entropy, for two reasons. In the first place your uncertainty function has been used in statistical mechanics under that name, so it already h...

Heart rate variability (HRV) is the variation of the time interval between consecutive heartbeats and depends on the extrinsic regulation of the heart rate. It can be quantified using nonlinear methods such as entropy measures, which determine the irregularity of the time intervals. In this work, approximate entropy (ApEn), sample entropy (SampEn), fuzzy entropy (FuzzyEn) and fuzzy measure entr...

Anew entropymeasure of interval-valued intuitionistic fuzzy set (IVIFS) is proposed by using cotangent function, which overcomes several limitations in the existing methods for calculating entropy of IVIFS. The efficiency of the new entropy is demonstrated by comparing it with several classical entropies.Moreover, an entropy weightmodel is established to determine the entropy weights for fuzzy ...

A new concept of the inclusion measure for intuitionistic fuzzy sets is proposed by the axiomatic definition. Also, the distance measures, similarity measures and information entropy are recalled and summarized. Most of important, some relationships among distance measure, information entropy, and inclusion measure of IFSs are then investigated. Finally, we obtain some important theorems by whi...

The entropy of intuitionistic fuzzy sets is used to indicate the degree of fuzziness of an interval-valued intuitionistic fuzzy set(IvIFS). In this paper, we deal with the entropies of IvIFSs. Firstly, we propose a set of entropies on IvIFSs with a parameter λ ∈ [0,+∞), which generalizes the entropy measure defined by Gao, for IvIFSs, and then we prove that the new entropy is an increasing func...