Interactions between multisensory integration and attention were studied using a combined audiovisual streaming design and a rapid serial visual presentation paradigm. Event-related potentials (ERPs) following audiovisual objects (AV) were compared with the sum of the ERPs following auditory (A) and visual objects (V). Integration processes were expressed as the difference between these AV and ...

For patients with pharmaco-resistant temporal epilepsy, unilateral anterior temporal lobectomy (ATL) - i.e. the surgical resection of the hippocampus, the amygdala, the temporal pole and the most anterior part of the temporal gyri - is an efficient treatment. There is growing evidence that anterior regions of the temporal lobe are involved in the integration and short-term memorization of objec...

In natural environments that contain multiple sound sources, acoustic energy arising from the different sources sums to produce a single complex waveform at each of the listener's ears. The auditory system must segregate this waveform into distinct streams to permit identification of the objects from which the signals emanate [1]. Although the processes involved in stream segregation are now re...

Figure 1: (a) The noisy predictions made by the per-pixel unary classifiers. (b) The output of the CRF using only visual features. (c) The use of auditory information improves material labeling. (d) Finally, joint optimisation between object and meterial categories improves object labelling as well. (e) The ground truth. (f) The input image, showing the locations where sound information is pres...

In sensory substitution devices (SSDs), visual information captured by an artificial receptor is delivered to the brain using non-visual sensory information. Using an auditory-to-visual SSD called "The vOICe" we previously reported that blind individuals perform successfully on object recognition tasks and are able to recruit specific ventral 'visual' structures for shape recognition using the ...

Echolocating bats can identify three-dimensional objects exclusively through the analysis of acoustic echoes of their ultrasonic emissions. However, objects of the same structure can differ in size, and the auditory system must achieve a size-invariant, normalized object representation for reliable object recognition. This study describes both the behavioral classification and the cortical neur...

An extension of the auditory module in EPIC is introduced to model the two-talker coordinate response measure (CRM) listening task. The construct of an auditory stream is employed as an object in the working memory of EPIC’s cognitive processor. Production rules are developed that execute the two-talker CRM task. Analysis of these rules reveal two sources of possible error in the output of the ...

Sound systems and speech technologies can benefit greatly from a deeper understanding of how the auditory system, and particularly the auditory cortex, is able to parse complex acoustic scenes into meaningful auditory objects and streams under adverse conditions. In the current work, a biologically plausible model of this process is presented, where the role of cortical mechanisms in organizing...

Infants and adults were presented with two moving objects accompanied by a single percussive sound. In different experiments, the sound occurred when one object moved through a particular spatial position, when it abruptly changed its direction of movement, or when it made contact with a rigid surface. Infants responded to the sound-object relationship whenever the sound occurred as the object ...

When concurrent acoustic signals are produced from different sources, their evolution in the spectro-temporal domain is independent. Each signal may however contain short-term spectral events with a common modulation of amplitude across time. This comodulation may be helpful for building auditory streams. When the information that is processed by two spectral channels share a common amplitude m...