We present an extension of the well-known information bottleneck framework, called conditional information bottleneck, which takes negative relevance information into account by maximizing a conditional mutual information score. This general approach can be utilized in a data mining context to extract relevant information that is at the same time novel relative to known properties or structures...

This paper introduces a bottleneck game with finite sets of commuters and departing time slots as an extension of congestion games by Milchtaich (1996). After characterizing Nash equilibrium of the game, we provide sufficient conditions for which the equivalence between Nash and strong equilibria holds. Somewhat surprisingly, unlike in congestion games, a Nash equilibrium in pure strategies may...

We define the relevant information in a signal x ∈ X as being the information that this signal provides about another signal y ∈ Y . Examples include the information that face images provide about the names of the people portrayed, or the information that speech sounds provide about the words spoken. Understanding the signal x requires more than just predicting y, it also requires specifying wh...

This paper describes an approach to alleviating the well-known problem of the knowledge acquisition bottleneck in knowledgebased systems. In knowledge-based, meaning-oriented natural language processing, the core knowledge resources are a semantic lexicon and an ontological world model in terms of which lexical meaning is expressed. We describe a mutual bootstrapping approach whereby existing r...