The brain tumour is the mass where some tissues become old or damaged, but they do not die leave their space. Mainly masses occur due to malignant masses. These must so that new are allowed be born and take place. Tumour segmentation a complex time-taking problem tumour’s size, shape, appearance variation. Manually finding such in by analyzing Magnetic Resonance Images (MRI) crucial task for ex...

We present a default-unification-based approach to ellipsis resolution that is based on experience in long running multimodal dialog projects, where it played an essential role in discourse processing. We extend default unification to non-parallel structures, which is important for speech and multimodal dialog systems. We introduce new control mechanisms for ellipsis resolution by considering d...

In this text we will present a novel solution for active perception built upon a probabilistic framework for multimodal perception of 3D structure and motion — the Bayesian Volumetric Map (BVM). This solution applies the notion of entropy to promote gaze control for active exploration of areas of high uncertainty on the BVM so as to dynamically build a spatial map of the environment storing the...

Although recent advances in multimodal chromatography have shown significant potential for selective protein purification, there is a need to establish a deeper understanding of the nature of selectivity in these systems. In this work, the adsorption behavior of a library of commercially available proteins with varying physicochemical properties was investigated. Linear gradient experiments wer...

Multimodal communication involves the co-occurrence of different communicative channels, including speech, eye gaze and facial expressions. The questions addressed in this study are how these modalities correlate and how they are aligned to the discourse structure. The study focuses on a map task scenario whereby participants coordinate a route on a map, while their speech, eye gaze, face and t...

We present a model for multimodal information retrieval, leveraging different information sources to improve the effectiveness of a retrieval system. This method takes into account multifaceted IR in addition to the semantic relations present in data objects, which can be used to answer complex queries, combining similarity and semantic search. By providing a graph data structure and utilizing ...

We evaluate here the ability of statistical models, namely Hidden Markov Models (HMMs) and Dynamic Bayesian Networks (DBNs), in capturing the interplay and coordination between multimodal behaviors of two individuals involved in a face-to-face interaction. We structure the intricate sensory-motor coupling of the joint multimodal scores by segmenting the whole interaction into so-called interact...

Structural information in language is important for obtaining a better understanding of a human communication (e.g., sentence segmentation, speaker turns, and topic segmentation). Human communication involves a variety of multimodal behaviors that signal both propositional content and structure, e.g., gesture, gaze, and body posture. These non-verbal signals have tight temporal and semantic lin...

There are two issues that are challenging in the life-cycle of Digital Talking Books (DTB): the automatic labeling of text formatting meta-data in documents and the multimodal representation of the text formatting semantics. We propose an augmented design-for-all approach for both the production and the reading processes of DAISY compliant DTBs. This approach incorporates a methodology for the ...