We present Submatrix-wise Vector Embedding Learner (Swivel), a method for generating lowdimensional feature embeddings from a feature co-occurrence matrix. Swivel performs approximate factorization of the point-wise mutual information matrix via stochastic gradient descent. It uses a piecewise loss with special handling for unobserved co-occurrences, and thus makes use of all the information in...

Registration of multi-modality images requires similarity measures that can deal with complex and unknown image intensity dependencies. Such measures have to rely on statistics, and consequently, they require relatively large image regions to operate. This makes the detection of localized image discrepancies difficult. As a solution we propose point similarity measures, which can measure simila...

Image guidance of ear surgery would enable an ENT surgeon to navigate about the components of the middle and inner ear, but the elaboration of anatomical models for this application is limited by the resolution of CT and its inability to distinguish among soft tissues. As a result, it is impossible to identify manually some tissues in clinical data, while visible tissues can only be identified ...

Increasing numbers of methodologies are available to find functional genomic clusters in RNA expression data. We describe a technique that computes comprehensive pair-wise mutual information for all genes in such a data set. An association with a high mutual information means that one gene is non-randomly associated with another; we hypothesize this means the two are related biologically. By pi...

Trust prediction is essential to enhancing reliability and reducing risk from the unreliable node, especially for online applications in open network environments. An fact trust measure relation of both interacting entities accurately. However, most existing methods infer between usually rely on modeling similarity nodes a graph ignore semantic influence negative links (e.g., distrust relation)...

Information theory-based metric such as mutual information (MI) is widely used as similarity measurement for multimodal registration. Nevertheless, this metric may lead to matching ambiguity for non-rigid registration. Moreover, maximization of MI alone does not necessarily produce an optimal solution. In this paper, we propose a segmentation-assisted similarity metric based on point-wise mutua...

We consider the discrete-time Gaussian channel with inter-symbol interference (ISI). Under the assumption of perfect feedback, an information-theoretic derivation of the minimum mean-squared error (MMSE) decision-feedback equalizer (DFE) is presented. Whereas previous works have used information theory to analyze the zero-forcing and MMSE DFE structures, this work derives the MMSE DFE directly ...