2 Mutual information 3 Mutual information . . . . . . . . . . . . . . . . 3 Multivariate mutual information . . . . . . . . . 3 Interaction information . . . . . . . . . . . . . . 4 Conditional mutual information . . . . . . . . . 5 Binding information . . . . . . . . . . . . . . . . 6 Residual entropy . . . . . . . . . . . . . . . . . . 6 Total correlation . . . . . . . . . . . . . . . . . . 6...

We design a new co-occurrence based word association measure by incorporating the concept of significant cooccurrence in the popular word association measure Pointwise Mutual Information (PMI). By extensive experiments with a large number of publicly available datasets we show that the newly introduced measure performs better than other co-occurrence based measures and despite being resource-li...

We present a suggestive finding regarding the loss of associative texture in the process of machine translation, using comparisons between (a) original and backtranslated texts, (b) reference and system translations, and (c) better and worse MT systems. We represent the amount of association in a text using word association profile – a distribution of pointwise mutual information between all pa...

—We study directed information in Bayesian networks and related structures. Mutual information is split into directed information and residual information. Some basic equations for directed information and residual information are determined.

The paper presents a system for locating a pun word. The developed method calculates a score for each word in a pun, using a number of components, including its Inverse Document Frequency (IDF), Normalized Pointwise Mutual Information (NPMI) with other words in the pun text, its position in the text, part-ofspeech and some syntactic features. The method achieved the best performance in the Hete...

This paper describes three systems from the University of Minnesota, Duluth that participated in the DiSCo 2011 shared task that evaluated distributional methods of measuring semantic compositionality. All three systems approached this as a problem of collocation identification, where strong collocates are assumed to be minimally compositional. duluth1 relies on the t-score, whereas duluth-2 an...