We present an experimental study on the effect of context and of audiovisual prosody on pragmatic focus interpretation. The audiovisual material was elicited from our previous production study on the exhaustivity of answers. Here we recorded nine German speakers who were instructed to read dialogues with embedded question-answer pairs in which the answer constituted the pragmatic focus of the u...

This document describes a PhD research track on the disclosure of audiovisual digital archives. The domain of audiovisual material is introduced as well as a problem description is formulated. The main research objective is to investigate the gap between the different users and the digital archives. Next, design research is proposed as a methodology for this research. Lastly, the social and sci...

This article presents an approach to crosscultural studies of advertising audiovisual material that departs from the typical rigid marketing models. It favours a more qualitative inductive approach to corpuses in which audiovisual texts are not approached or compared through the use of standardised American tools. After reviewing the usual marketing tools, the article focuses on the steps resea...

the seventh art has stabilized its proper place in the social and cultural level in different societies of the world. although, in this art, the picture, sound, music and movement are very important but the role of speech in the transmission of sense is undeniable. development and presentation of this art to the audience depends greatly on translation of the speech from the original language to...

For effective interactions with our dynamic environment, it is critical for the brain to integrate motion information from the visual and auditory senses. Combining fMRI and psychophysics, this study investigated how the human brain integrates auditory and visual motion into benefits in motion discrimination. Subjects discriminated the motion direction of audiovisual stimuli that contained dire...

We used human electroencephalogram to study early audiovisual integration of dynamic angry and neutral expressions. An auditory-only condition served as a baseline for the interpretation of integration effects. In the audiovisual conditions, the validity of visual information was manipulated using facial expressions that were either emotionally congruent or incongruent with the vocal expression...

In this work, we present a method that jointly separates active audio and visual structures on a given mixture. This new concept, the Blind Audiovisual Source Separation (BAVSS), is achieved by exploiting the coherence existing between the recorded signal of a video camera and only one microphone. An efficient representation of audio and video sequences allows to build robust audiovisual relati...

The neural activity of speech sound processing (the N1 component of the auditory ERP) can be suppressed if a speech sound is accompanied by concordant lip movements. Here we demonstrate that this audiovisual interaction is neither speech specific nor linked to humanlike actions but can be observed with artificial stimuli if their timing is made predictable. In Experiment 1, a pure tone synchron...

Based on behavioral evidence, audiovisual speech perception is generally thought to proceed linearly from initial unimodal perceptual processing to integration of the unimodally processed information. We investigated unimodal versus audiovisual speech processing using electrical event-related potentials (ERPs) obtained from twelve adults. Nonsense syllable stimuli were presented in an oddball p...

It is well established that multisensory integration is a functional characteristic of the superior colliculus that disambiguates external stimuli and therefore reduces the reaction times toward simple audiovisual targets in space. However, in a condition where a complex audiovisual stimulus is used, such as the optical flow in the presence of modulated audio signals, little is known about the ...