This paper investigates audio-visual interaction, i.e. inter-modal influences, in linear-regressive model adaptation for multi-modal speech recognition. In the multi-modal adaptation, inter-modal information may contribute the performance of speech recognition. Thus the influence and advantage of intermodal elements should be examined. Experiments were conducted to evaluate several transformati...

in treating the subject of musical language, a persian musician would be intrinsically drawn to the structural similarities between the persian music and language. indeed persian music and language are extremely related in their metrics, intonations and structural phrases (syntax). although we will draw upon this relationship, our aim in this article is to present “music as a language,” consist...

Multi-modal semantics has relied on feature norms or raw image data for perceptual input. In this paper we examine grounding semantic representations in raw auditory data, using standard evaluations for multi-modal semantics, including measuring conceptual similarity and relatedness. We also evaluate cross-modal mappings, through a zero-shot learning task mapping between linguistic and auditory...

Multi-modal imaging systems have recently been drawing attention in fields such as medical imaging, remote sensing and video surveillance systems. In such systems, estimating depth has become possible due to promising progress of multi-modal matching techniques. In this article, we perform a systematic performance evaluation of similarity measures frequently used in the literature for dense mul...

Multi-modal techniques have received increasing interest in the neuroscientific and brain computer interface (BCI) communities in recent times. Two aspects of multi-modal imaging for BCI will be reviewed. First, the use of recordings of multiple subjects to help find subject-independent BCI classifiers is considered. Then, multi-modal neuroimaging methods involving combined electroencephalogram...

The Multi-objective transportation problem (MOTSP) is a of linear type optimization problem which contains all equality type constraints and the multi variable objectives. Here we have presented an application of Evolutionary Algorithms to the multi-objective transportation problem (MOTSP). We consider the multi-objective transportation problem as linear optimization problem and use a special t...

Crack identification is a very important issue in mechanical systems, because it is a damage that if develops may cause catastrophic failure. In the first part of this research, modal analysis of a multi-cracked variable cross-section beam is done using finite element method. Then, the obtained results are validated usingthe results of experimental modal analysis tests. In the next part, a nove...

The ability to represent knowledge about space and its position therein is crucial for a mobile robot. To this end, topological and semantic descriptions are gaining popularity for augmenting purely metric space representations. In this paper we present a multi-modal place classification system that allows a mobile robot to identify places and recognize semantic categories in an indoor environm...