A voice to facial animation conversion system is presented in this paper. In particular the temporal structure of the multimodal speech is discussed. Mutual information and neural network training is used to estimate the optimal temporal scope for audio to video conversion.

Artificial Intelligence (AI) techniques are known for its ability in tackling problems found to be unyielding to traditional mathematical methods. A recent addition to these techniques are the Computational Intelligence (CI) techniques which, in most cases, are nature or biologically inspired techniques. Different CI techniques found their way to many control engineering applications, including...

Unimodal biometrics has several problems such as noisy data, intra class variation, inter class similarities, non universality and spoofing which cause this system less accurate and secure. To overcome these problems and to increase level of security multimodal biometrics is used. Multimodal biometrics makes the use of multiple source of information for personal authentication. Multimodal biome...

Persuasion is an emerging topic in the field of Human Computer Interaction: persuasion functions will improve the effectiveness of intelligent interfaces. The focus of this paper regards how persuasion affects Rhetorical Relation (RR) selection in the generation of an effective, and context-adapted, message. Using a taxonomy of persuasive strategies, together with a reasoning model, a tree-like...

In this paper we describe a new automated suite of tools for capturing and analyzing data on multimodal systems called STAMP. STAMP is designed to support research and development efforts for advancing next-generation multimodal systems. STAMP permits researchers to analyze multimodal system performance by: (1) recording data on users’ multimodal input and the system’s responding, (2) supportin...

We describe ProFeel, an application for exploring molecular data from protein structure-structure alignments using a force-feedback joystick. Protein structure analysis is a useful application for multimodal information perceptualization because researchers in this area typically use several independent measures in assessment. A system that allows the user to simultaneously evaluate different c...