Some non-coding small RNAs, known as microRNAs (miRNAs), have been shown to play important roles in gene regulation and various biological processes. The abnormal expression of some specific miRNA genes often results in the development of cancer. In this paper, we find discriminatory miRNA patterns for cancer classification from miRNA expression profiles with an information theory approach. Our...

Mutual information between stimulus and response has been advocated as an information theoretic measure of a neural system's capability to process information. Once calculated, the result is a single number that supposedly captures the system's information characteristics over the range of stimulus conditions used to measure it. I show that mutual information is a awed measure, the standard app...

In this paper a system for tracking multiple targets in 3D is described. The system is made up of two pan-and-tilt units that are attached to the extremities of a rotating arm. This configuration has several advantages and can deal with several specific instances of tracking more than one target. A control strategy that guarantees equal target disparities in both images whenever targets are see...

We give two theories, Th1 and Th2, which are explicitly definable over each other (i.e. the relation symbols of one theory are explicitly definable in the other, and vice versa), but are not definitionally equivalent. The languages of the two theories are disjoint.

We propose new measures of shared information, unique information and synergistic information that can be used to decompose the mutual information of a pair of random variables (Y, Z) with a third random variable X . Our measures are motivated by an operational idea of unique information, which suggests that shared information and unique information should depend only on the marginal distributi...

Molecular communication is a biologically-inspired method of communication with attractive properties for microscale and nanoscale devices. In molecular communication, messages are transmitted by releasing a pattern of molecules at a transmitter, which propagate through a fluid medium towards a receiver. In this paper, molecular communication is formulated as a mathematical communication proble...

As a possible generalization of Shannon’s information theory, we review the formalism based on the non-logarithmic information content parametrized by a real number q, which exhibits nonadditivity of the associated uncertainty. Moreover it is shown that the establishment of the concept of the mutual information is of importance upon the generalization.

Feature selection and dimensionality reduction is important for high dimensional signal processing and pattern recognition problems. Feature selection can be achieved by filter approach, in which certain criteria must be optimized. By using mutual information (MI) between feature vectors and class labels as the criterion, we proposed an ICA-MI framework for feature selection. In this paper, we ...

Recently, mutual information (MI) has become widely recognized as a statistical measure of dependence that is suitable for applications where data are non-Gaussian, or where the dependency between variables is non-linear. However, a significant disadvantage of this measure is the inability to define an analytical expression for the distribution of MI estimators, which are based upon a finite da...

Mutual information (MI) is a common criterion in independent component analysis (ICA) optimization. MI is derived from probability density functions (PDF). There are scenarios in which assuming a parametric form for the PDF leads to poor performance. Therefore, the need arises for non-parametric PDF and MI estimation. Existing nonparametric algorithms suffer from high complexity, particularly i...