Honey bees (Apis mellifera L.) are eusocial insects and well known for their complex division of labor and associative learning capability(1, 2). The worker bees spend the first half of their life inside the dark hive, where they are nursing the larvae or building the regular hexagonal combs for food (e.g. pollen or nectar) and brood(3). The antennae are extraordinary multisensory feelers and p...

Speech recognition and speech translation are traditionally addressed by processing acoustic signals while nonlinguistic information is typically not used. In this paper, we present a new method which explores the spoken word learning from naturally co-occurring multisensory information in a dyadic(two-person) conversation. It has been noticed that the listener always has a strong tendency to l...

It is currently unknown whether statistical learning is supported by modality-general or modality-specific mechanisms. One issue within this debate concerns the independence of learning in one modality from learning in other modalities. In the present study, the authors examined the extent to which statistical learning across modalities is independent by simultaneously presenting learners with ...

Suppose that you are at a live jazz show. The drummer begins a solo. You see the cymbal jolt and you hear the clang. But in addition seeing the cymbal jolt and hearing the clang, you are also aware that the jolt and the clang are part of the same event. Casey O'Callaghan (forthcoming) calls this awareness "intermodal feature binding awareness." Psychologists have long assumed that multimodal pe...

Multisensory integration is essential for the expression of complex behaviors in humans and animals. However, few studies have investigated the neural sites where multisensory integration may occur. Therefore, we used electrophysiology and retrograde labeling to study a region of the rat parietotemporal cortex that responds uniquely to auditory and somatosensory multisensory stimulation. This m...

We present MINOS, a simulator designed to support the development of multisensory models for goal-directed navigation in complex indoor environments. The simulator leverages large datasets of complex 3D environments and supports flexible configuration of multimodal sensor suites. We use MINOS to benchmark deep-learning-based navigation methods, to analyze the influence of environmental complexi...

The intricate relationship between multisensory integration and attention has been extensively researched in the multisensory field; however, the necessity of attention for the binding of multisensory stimuli remains contested. In the current study, we investigated whether diverting attention from well-known multisensory tasks would disrupt integration and whether the complexity of the stimulus...

Sensorimotor co-ordination in mammals is achieved predominantly via the activity of the basal ganglia. To investigate the underlying multisensory information processing, we recorded the neuronal responses in the caudate nucleus (CN) and substantia nigra (SN) of anaesthetized cats to visual, auditory or somatosensory stimulation alone and also to their combinations, i.e. multisensory stimuli. Th...

BACKGROUND The formation of an odor percept in humans is strongly associated with visual information. However, much less is known about the roles of learning and memory in shaping the multisensory nature of odor representations in the brain. METHOD The dynamics of odor and visual association in olfaction was investigated using three functional magnetic resonance imaging (fMRI) paradigms. In t...