There is an opportunity to consider the theory of visualization for each of our senses together. We should have a united theory of visualization that covers all senses and allows users to integrate modalities. We believe there are several important facets to the theory that need to be addressed at all stages of the multi-sensory visualization process. (1) Data enhancement for multi-sensory visu...

Synesthesia is a condition in which stimulation in one modality also gives rise to a perceptual experience in a second modality. In two recent studies we found that the condition is more common than previously reported; up to 5% of the population may experience at least one type of synesthesia. Although the condition has been traditionally viewed as an anomaly (e.g., breakdown in modularity), i...

Previous psychological studies have shown that musical chords primed by Western musical scale in a tonal and modal schema are perceived in a hierarchy of stability. We investigated such priming effects on auditory magnetic responses to tonic-major and submediant-minor chords preceded by major scales and tonic-minor and submediant-major chords preceded by minor scales. Musically trained subjects...

Experiencing a stimulus in one sensory modality is often associated with an experience in another sensory modality. For instance, seeing a lemon might produce a sensation of sourness. This might indicate some kind of cross-modal correspondence between vision and gustation. The aim of the current study was to explore whether such cross-modal correspondences influence cross-modal integration duri...

According to an embodied view of language comprehension, language concepts are grounded in our perceptual systems. Evidence for the idea that concepts are grounded in areas involved in action and perception comes from both behavioral and neuroimaging studies (Glenberg [1997]: Behav Brain Sci 20:1-55; Barsalou [1999]: Behav Brain Sci 22:577-660; Pulvermueller [1999]: Behav Brain Sci 22:253-336; ...

The sensorimotor approach proposes that perception is constituted by the mastery of lawful sensorimotor regularities or sensorimotor contingencies (SMCs), which depend on specific bodily characteristics and on actions possibilities that the environment enables and constrains. Sensory substitution devices (SSDs) provide the user information about the world typically corresponding to one sensory ...

Person recognition can be accomplished through several modalities (face, name, voice). Lesion, neurophysiology and neuroimaging studies have been conducted in an attempt to determine the similarities and differences in the neural networks associated with person identity via different modality inputs. The current study used event-related functional-MRI in 17 healthy participants to directly comp...

Perceiving the temporal order of sensory events typically depends on participants' attentional state, thus likely on the endogenous fluctuations of brain activity. Using magnetoencephalography, we sought to determine whether spontaneous brain oscillations could disambiguate the perceived order of auditory and visual events presented in close temporal proximity, that is, at the individual's perc...

Recalling information involves the process of discriminating between relevant and irrelevant information stored in memory. Not infrequently, the relevant information needs to be selected from among a series of related possibilities. This is likely to be particularly problematic when the irrelevant possibilities not only are temporally or contextually appropriate, but also overlap semantically w...

Attention is a core property of all perceptual and cognitive operations. Given limited capacity to process competing options, attentional mechanisms select, modulate, and sustain focus on information most relevant for behavior. A significant problem, however, is that attention is so ubiquitous that it is unwieldy to study. We propose a taxonomy based on the types of information that attention o...