Mutual information (MI) is one of the most popular and widely used similarity measures in image registration. In traditional registration processes, MI computed each optimization step to measure between reference moving image. The presumption that whenever reaches its highest value, this corresponds best match. This paper shows not always valid leads error. To overcome problem, we propose use p...

It is well known that multi-word expressions are problematic in natural language processing. In previous literature, it has been suggested that information about their degree of compositionality can be helpful in various applications but it has not been proven empirically. In this paper, we propose a framework in which information about the multi-word expressions can be used in the word-alignme...

Despite their great success in practical applications, there is still a lack of theoretical and systematic methods to analyze deep neural networks. In this paper, we illustrate an advanced information theoretic methodology to understand the dynamics of learning and the design of autoencoders, a special type of deep learning architectures that resembles a communication channel. By generalizing t...

This paper addresses the problem of finding a subset of the acoustic feature space that best represents the phoneme set used in a speech recognition system. A maximum mutual information approach is presented for selecting acoustic features to be combined together to represent the distinctions among the phonemes. The overall phoneme recognition accuracy is slightly increased for the same length ...

mutual information (mi) is a widely used similarity metric for multimodality image registration. however, it involves an extremely high computational time especially when it is applied to volume images. moreover, its robustness is affected by existence of local maxima. the multi-resolution pyramid approaches have been proposed to speed up the registration process and increase the accuracy of th...

Sentiment visualization on tweet topics has recently gained attentions due to its ability to efficiently analyze and understand the people’s feelings for individuals and companies. In this paper, we propose a chart, SentimentRiver, which effectively demonstrates the dynamics of sentiment evolvement on a topic of tweets. The gradient colors of the river flow indicate the variation of topical sen...

In cross-language information retrieval it is often important to align words that are similar in meaning in two corpora written in different languages. Previous research shows that using context similarity to align words is helpful when no dictionary entry is available. We suggest a new method which selects a subset of words (pivot words) associated with a query and then matches these words acr...