This study investigated people's sensitivity to audiovisual asynchrony in briefly-presented speech and musical videos. A series of speech (letters and syllables) and guitar and piano music (single and double notes) video clips were presented randomly at a range of stimulus onset asynchronies (SOAs) using the method of constant stimuli. Participants made unspeeded temporal order judgments (TOJs)...

Visual attention in tranquility evaluations has been examined by eye tracking experiments using audiovisual materials collected in traditional villages of China. The results show that without sound stimuli, the attention areas in tranquility evaluations are more concentrated, compared with those in visual aesthetic quality evaluations. With sound stimuli, the attention areas of tranquility eval...

Using Focus of Attention (FoA) as a perceptual process in image and video compression belongs to well-known approaches to increase coding efficiency. It has been shown that foveated coding, when compression quality varies across the image according to region of interest, is more efficient than the alternative coding, when all region are compressed in a similar way. However, widespread use of su...

INTRODUCTION Repair of retinal detachment frequently requires use of intraocular gas. Patients are instructed to position themselves postoperatively to appose the intraocular bubble to the retinal break(s). We developed a novel wearable wireless positioning sensor, which provides real-time audiovisual feedback on the accuracy of positioning. METHODS Eight healthy volunteers wore the wireless ...

This paper investigates multi-modal aspects of audiovisual quality assessment for interactive communication services. It shows how perceived auditory and visual qualities integrate to an overall audiovisual quality perception in different experimental contexts. Two audiovisual experiments are presented and provide experimental data for the present analysis. First, two experimental contexts are ...

Neural representation of auditory regularities can be probed using the MMN, a component of ERPs generated in the auditory cortex by any violation of that regularity. Although several studies have shown that visual information can influence or even trigger an MMN by altering an acoustic regularity, it is not known whether audiovisual regularities are encoded in the auditory representation suppor...

Lip reading relies on visible articulators to ease audiovisual speech understanding. However, lips and face alone provide very incomplete phonetic information: the tongue, that is generally not entirely seen, carries an important part of the articulatory information not accessible through lip reading. The question was thus whether the direct and full vision of the tongue allows tongue reading. ...

OBJECTIVE To investigate the impact of pediatric traumatic brain injury (TBI) on multisensory integration in relation to general neurocognitive functioning. METHOD Children with a hospital admission for TBI aged between 6 and 13 years (n = 94) were compared with children with trauma control (TC) injuries (n = 39), while differentiating between mild TBI without risk factors for complicated TBI...

PURPOSE To compare audio-only biofeedback to conventional audiovisual biofeedback for regulating patients' respiration during four-dimensional radiotherapy, limiting damage to healthy surrounding tissues caused by organ movement. MATERIALS AND METHODS Six healthy volunteers were assisted by audiovisual or audio-only biofeedback systems to regulate their respirations. Volunteers breathed throu...

We focused on brain areas activated by audiovisual stimuli related to swallowing motions. In this study, three kinds of stimuli related to human swallowing movement (auditory stimuli alone, visual stimuli alone, or audiovisual stimuli) were presented to the subjects, and activated brain areas were measured using fMRI and analyzed. When auditory stimuli alone were presented, the supplementary mo...