This paper describes two experiments on the role of audiovisual prosody for signalling and detecting meta-cognitive information in question answering. The Wrst study consists of an experiment, in which participants are asked factual questions in a conversational setting, while they are being Wlmed. Statistical analyses bring to light that the speakers’ Feeling of Knowing (FOK) is cued by a numb...

Although pitch is a fundamental attribute of auditory perception, substantial individual differences exist in our ability to perceive differences in pitch. Little is known about how these individual differences in the auditory modality might affect crossmodal processes such as audiovisual perception. In this study, we asked whether individual differences in pitch perception might affect audiovi...

The emotional response to synchronous instances between musical and visual elements within the cinematic experience awaits thorough empirical evaluation. Film composition is defined here as a genre of stereotypes, whose methodologies are not feasibly subject to redevelopment. As consequence, the research focuses on improving the enculturated functions of film music. Hypothesising that an increa...

As Web-based courses using videos have become popular in recent years, the issue of managing audiovisual aids has become noteworthy. The contents of audiovisual aids may include a lecture, an interview, a featurette, an experiment, etc. The audiovisual aids of Web-based courses are transformed into the streaming format that can make the quality of Internetbased videos acceptable to learners usi...

Both auditory and visual information plays an important role for audiovisual speech perception during face-to-face communication. Several behavioral studies have shown that native English speakers and native Japanese speakers behaved differently in audiovisual speech perception. We hypothesized that there would be differences in neural processing between native English speakers and native Japan...

Audiovisual data have gained an enormous and ever-growing popularity in the world wide web. Also a growing number of educational content such as, e.g. lecture recordings or audiovisual learning material can be found recently. But, pinpoint and exhaustive retrieval of audiovisual elearning content in the web is rather difficult as well as automated metadata interchange and integration. We demons...

The role of visual cues in native listeners' perception of speech produced by nonnative speakers has not been extensively studied. Native perception of English sentences produced by native English and Korean speakers in audio-only and audiovisual conditions was examined. Korean speakers were rated as more accented in audiovisual than in the audio-only condition. Visual cues enhanced word intell...

Robust perception requires efficient integration of information from our various senses. Much recent electrophysiology points to neural areas responsive to multisensory stimulation, particularly audiovisual stimulation. However, psychophysical evidence for functional integration of audiovisual motion has been ambiguous. In this study we measure perception of an audiovisual form of biological mo...

In this paper we present a formal framework for the representation of audiovisual material produced or broadcasted by a TV company. Such a framework captures not only features related to the making of audiovisual objects but also features related to their inner structure. The framework exploits the compositional nature of audiovisual objects, and includes the possibility of dealing with broadca...