In this paper, we introduce a non-linear enhancement technique called Audio-Visual Codebook Dependent Cepstral Normalization (AVCDCN) and we consider its use with both audio-only and audio-visual speech recognition. AVCDCN is inspired from CDCN [1] [2], an audio-only enhancement technique that approximates the non-linear effect of noise on speech with a piece-wise constant function. Our experim...

Multiple emotion regulation strategies have been identified and found to differ in their effectiveness at decreasing negative emotions. One reason for this might be that individual strategies are associated with differing levels of cognitive demand and require distinct patterns of visual attention to achieve their effects. In the current study, we tested this hypothesis in a sample of psychiatr...

Although humans are almost constantly exposed to stimuli from multiple sensory modalities during daily life, the processes by which we learn to integrate information from multiple senses to acquire knowledge of multisensory objects are not well understood. Here, we present results of a novel audio-visual statistical learning procedure where participants are passively exposed to a rapid serial p...

The negative impact of external interference on working memory (WM) performance is well documented; yet, the mechanisms underlying this disruption are not sufficiently understood. In this study, electroencephalogram and functional magnetic resonance imaging (fMRI) data were recorded in separate experiments that each introduced different types of visual interference during a period of WM mainten...

Differences in perceptual and cognitive abilities between the young and elderly have implications for in-car tasks. As a primary example, although in-car navigation systems enhance situational awareness, this comes at the cost of increasing visual distraction and cognitive load. To address these shortcomings, this paper explores the efficacy of multi-modal cues for providing route guidance info...

Unexpectedly occurring task-irrelevant stimuli have been shown to impair performance. They capture attention away from the main task leaving fewer resources for target processing. However, the actual distraction effect depends on various variables; for example, only target-informative distractors have been shown to cause costs of attentional orienting. Furthermore, recent studies have shown tha...

Driver distraction is strongly associated with crashes and near-misses, and despite the attention this topic has received in recent years, the effect of different types of distracting task on driving performance remains unclear. In the case of non-visual distractions, such as talking on the phone or other engaging verbal tasks that do not require a visual input, a common finding is reduced late...

conclusions this study showed that audio-visual training can have a significant effect on the self-efficacy of people with type 1 diabetes. providing audio-visual equipment to referral centers of type 1 diabetics, such as hospitals, health centers, and clinics, as well as informing related officials, can be of benefit to managers. results the mean of the self-efficacy score improved significant...

This work aims to understand and model the inter-modal temporal relations between the audio and visual modalities of speech and validate whether the captured relations can improve the performance of audio-visual bimodal modeling for such applications as audio-visual speaker identification. We propose to extend our audio-visual correlative model (AVCM) with explicit durational modeling of the pa...