A Multimodal Information System aims to provide transport customers pertinent real time information during their travels. The world Multimodal means different types of transport devices but we choose to expand accessible services to various kind of information (transport, weather, stock exchange, itinerary, traffic, perturbations...) in order to provide travellers required information in any ch...

Computer-based logic proofs are a form of ’unnatural’ language discourse, but the structure and process of proof can be observed in considerable detail, and analysis is leading to a number of general insights. We have been studying how students respond to multimodal logic teaching. First, psychological measures indicate that students’ pre-existing cognitive styles have a sigaificant impact on t...

Human utterances demonstrate temporal patterning, also referred to as rhythm. While simple oromotor behaviors (e.g., chewing) feature a salient periodical structure, conversational speech displays a time-varying quasi-rhythmic pattern. Quantification of periodicity in speech is challenging. Unimodal spectral approaches have highlighted rhythmic aspects of speech. However, speech is a complex mu...

The exceptionally strong optoelectronic sensitivity of PTCDI-Ph have been correlated with its structure and unconventional elasticity, offering an opportunity for developing new multimodal sensors exceptional stability towards external stimuli.

In this paper, we present a novel deep multimodal framework to predict human emotions based on sentence-level spoken language. Our architecture has two distinctive characteristics. First, it extracts the high-level features from both text and audio via a hybrid deep multimodal structure, which considers the spatial information from text, temporal information from audio, and high-level associati...

BACKGROUND Autism spectrum disorder (ASD) and obsessive-compulsive disorder (OCD) share inhibitory control deficits possibly underlying poor control over stereotyped and repetitive and compulsive behaviors, respectively. However, it is unclear whether these symptom profiles are mediated by common or distinct neural profiles. This comparative multimodal meta-analysis assessed shared and disorder...

Individuals with music training in early childhood show enhanced processing of musical sounds, an effect that generalizes to speech processing. However, the conclusions drawn from previous studies are limited due to the possible confounds of predisposition and other factors affecting musicians and nonmusicians. We used a randomized design to test the effects of a laboratory-controlled music int...

As indicated by many researchers (Lecomte, 1998; Cornell, 1997) the minimalist framework as worked out in the Minimalist Program (Chomsky, 1995) and the resource conscious logics such as Multimodal Categorial Grammar (Moortgat, 1996) show many similarities. The two theories are the product of distinct scientific traditions, but they aim to give a similar explanation for grammatical knowledge an...

The goal of this paper is to model the coverbal behavior of a subject involved in face-to-face social interactions. For this end, we present a multimodal behavioral model based on a Dynamic Bayesian Network (DBN). The model was inferred from multimodal data of interacting dyads in a specific scenario designed to foster mutual attention and multimodal deixis of objects and places in a collaborat...