We propose a unifying picture where the notion of generalized entropy is related to information theory by means of a group-theoretical approach. The group structure comes from the requirement that an entropy be well defined with respect to the composition of independent systems, in the context of a recently proposed generalization of the Shannon-Khinchin axioms. We associate to each member of a...

The information boundedness principle requires that the knowledge obtained as a result of an inference process should not have more information than that contained in the consequent of the rule. From this point of view relevancy transformation operators as a generalization of implications are investigated.

The information boundedness principle for rule based inference process requires that the knowledge obtained as a result of a rule should not have more information than that contained in the consequent of this rule. We formulate the information boundedness principle for aggregation and show that it can be expressed using the notion of dominance. We also investigate conditions under which this pr...

 In a number of life-testing experiments, there exist situations where the monitoring breaks down for a temporary period of time. In such cases, some parts of the ordered observations, for example the middle ones, are censored and the only outcomes available for analysis consist of the lower and upper order statistics. Therefore, the experimenter may not gain the complete information on fa...

In an effort to better understand the complex courtship behaviour of pigeons, we have built a model learned from motion capture data. We employ a Conditional Restricted Boltzmann Machine (CRBM) with binary latent features and real-valued visible units. The units are conditioned on information from previous time steps to capture dynamics. We validate a trained model by quantifying the characteri...

We demonstrate a generalization of Maximum Entropy Density Estimation that elegantly handles incomplete presence-only data. We provide a formulation that is able to learn from known values of incomplete data without having to learn imputed values, which may be inaccurate. This saves the effort needed to perform accurate imputation while observing the principle of maximum entropy throughout the ...

Land surface temperature (LST) plays a major role in the study of surface energy balances. Remote sensing techniques provide ways to monitor LST at large scales. However, due to atmospheric influences, significant missing data exist in LST products retrieved from satellite thermal infrared (TIR) remotely sensed data. Although passive microwaves (PMWs) are able to overcome these atmospheric infl...

Reasoning with inaccurate information is a major topic within the fields of artificial intelligence in general and knowledge representation and reasoning in particular. This thesis deals with information that can be incomplete, uncertain, and contradictory. We employ probabilistic conditional logic as a foundation for our investigation. This framework allows for the representation of uncertain ...

In this paper we present an analysis of information transfer based on Landauer s principle (i.e., erasure of information is associated with an increase in entropy), as well as considerations of analyticity and causality. We demonstrate that holomorphic functions allowing complete analytic continuation cannot propagate any information, such that information transfer only occurs with analytic fun...