Sparse data causes errors in the maximum-likelihood estimates of event probabilities that are often large enough to render measures of association such as pointwise mutual information useless for small sample sizes. This squib describes a procedure for estimating event probabilities that produces a conndence interval estimate rather than a point estimate. Using these conndence intervals in calc...

A set of standard answers facilitates answering emails at customer care centers. Matching the text of user emails to the standard answers may not be productive because they do not necessarily have the same wording. Therefore we examine archived email-answer pairs and establish query-answer term co-occurrences. When a new user email arrives, we replace query words with most co-occurring answer w...

In this paper, a new technique is introduced that relaxes the HMM conditional independence assumption in a principled way. Without increasing the number of states, the modeling power of an HMM is increased by including only those additional probabilistic dependencies (to the surrounding observation context) that are believed to be both relevant and discriminative. Conditional mutual information...

0950-7051/$ see front matter 2013 Elsevier B.V. A http://dx.doi.org/10.1016/j.knosys.2013.01.001 ⇑ Corresponding author. Tel.: +886 3 463 8800x230 E-mail address: [email protected] (P.-C Sentiment classification of stock market news involves identifying positive and negative news articles, and is an emerging technique for making stock trend predictions which can facilitate investor dec...

The aim of the current paper is to formulate a conception of pragmatic patterns characterizing the construction of individual and collective identities in virtual communities (in our case: the Twitter community). We have explored several theoretical approaches and frameworks and relevant empirical data to show that the agents building virtual communities are 'extended selves' grounded in a high...

Bayesian testing of a point null hypothesis is considered. The null hypothesis is that an observation, x, is distributed according to the normal distribution with a mean of zero and known variance σ. The alternative hypothesis is that x is distributed according to a normal distribution with an unknown nonzero mean, μ, and variance σ. The testing problem is formulated as a prediction problem. Ba...

6 This paper presents a neuroscience inspired information theoretic approach 7 to motion segmentation. Robust motion segmentation represents a funda8 mental first stage in many surveillance tasks. As an alternative to widely 9 adopted individual segmentation approaches, which are challenged in differ10 ent ways by imagery exhibiting a wide range of environmental variation and 11 irrelevant moti...

Many Japanese words are made of kanji characters, which themselves represent meanings. However traditional word-based distributional semantic models (DSMs) do not benefit from the useful semantic information of kanji characters. In this paper, we propose a method for exploiting the semantic information of kanji characters for constructing Japanese word vectors in DSMs. In the proposed method, t...

Given a collection of random variables i ] i2N where N is a nite nonempty set, the corresponding multiinformation function ascribes the relative entropy of the joint distribution of i ] i2A with respect to the product of distributions of individual random variables i for i 2 A to every subset A N. We argue it is a useful tool for problems concerning stochastic (conditional) dependence and indep...

The main aim of this contribution is to define the notions of Kullback-Leibler divergence and conditional mutual information in fuzzy probability spaces and to derive the basic properties of the suggested measures. In particular, chain rules for mutual information of fuzzy partitions and for Kullback-Leibler divergence with respect to fuzzy P-measures are established. In addition, a convexity o...