This paper discusses concepts of self-organized complexity and the theory of Coherent Infomax in the light of Jaynes’s probability theory. Coherent Infomax, shows, in principle, how adaptively self-organized complexity can be preserved and improved by using probabilistic inference that is context-sensitive. It argues that neural systems do this by combining local reliability with flexible, holi...

We present a system for non-monotonic reasoning based on the probability calculus. This calculus incorporates this type of reasoning in two ways: Non-monotonic decisions (which can be treated as decisions under incomplete knowledge as well) can be the result of reasoning in a single probability model (via conditionalization) or in a set of probability models (via additional principles of ration...

In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...

The purpose of this study is to define the concepts of Tsallis entropy and conditional Tsallis entropy of fuzzy partitions and to obtain some results concerning this kind entropy. We show that the Tsallis entropy of fuzzy partitions has the subadditivity and concavity properties. We study this information measure under the refinement and zero mode subset relations. We check the chain rules for ...

The problem of estimating the power consumption at logic and register transfer levels is addressed from an information theoretical point of view. It is shown that the average switching activity can be predicted without simulation using either entropy or informational energy averages. Consequently, two new measures relying on these concepts are developed. The accuracy of these models is investig...

the second law of thermodynamic (entropy principle) is of special theo-philosophical importance. it seems that this law, which is renowned as “the death of software design” and despite the order in the world, is like an incompatible universal. this article examines the concept of entropy in the three temperature, statistic, and information applications and addresses the contradiction of the sec...

We apply methods of abduction derived from propositional probabilistic reasoning to predicate probabilistic reasoning, in particular inductive logic, by treating finite predicate knowledge bases as potentially infinite propositional knowledge bases. It is shown that for a range of predicate knowledge bases (such as those typically associated with inductive reasoning) and several key proposition...

In this paper one presents new similarity, cardinality and entropy measures for bipolar fuzzy set and for its particular forms like intuitionistic, paraconsistent and fuzzy set. All these are constructed in the framework of multi-valued representations and are based on a penta-valued logic that uses the following logical values: true, false, unknown, contradictory and ambiguous. Also a new dist...

Gnedenko, the father of the modern Reliability Theory, first derived some fundamental properties of reliable systems following rigid deductive logic. This paper shares the deductive method and infers four principal properties of repairable/maintainable systems using the Boltzmann-like entropy. In particular we calculate the reparability function and next discuss the physical meanings of the for...