The unity of heterogeneous sensory channels plays an essential role in our learning and development. multisensory approaches to imply a simultaneous use visual, auditory, kinesthetic-tactile other possible modalities. paper analyses the affordances via framework semiotics culture contemporary research education, as well explores relations between perception environment multimodality representat...

Copyright Information: All rights reserved unless otherwise indicated. Contact the author or original publisher for any necessary permissions. eScholarship is not the copyright owner for deposited works. Learn more at Evidence suggests that the core cognitive features of schizophrenia (SZ) include impairments in auditory and visual memory systems and that each of these deficits individually cor...

At present, it is largely unclear how the human brain optimally learns foreign languages. We investigated teaching strategies that utilize complementary information ("enrichment"), such as pictures or gestures, to optimize vocabulary learning outcome. We found that learning while performing gestures was more efficient than the common practice of learning with pictures and that both enrichment s...

The integration of multisensory information plays a crucial role in autonomous robotics. In this work, we investigate how robust multimodal representations can naturally develop in a self-organized manner from co-occurring multisensory inputs. We propose a hierarchical learning architecture with growing self-organizing neural networks for learning human actions from audiovisual inputs. Associat...

Smart learning environments (SLEs) leverage technological developments to enable effective, engaging and personalized learning. SLEs rely on sensor advanced interconnectivity capabilities infer reason. A natural set of affordances for are those Multisensory Environments (MSEs). MSEs humans make full use their senses equip systems with new information, methods information exchange, intelligent c...

The classical view of sensory processing involves independent processing in sensory cortices and multisensory integration in associative areas. This hierarchical structure has been challenged by evidence of multisensory responses in sensory areas, and dynamic weighting of sensory inputs in associative areas, thus far reported independently. Here, we used a visual-to-auditory sensory substitutio...

The goal of the present study was to find evidence for a multisensory generalization effect (i.e., generalization from one sensory modality to another sensory modality). The authors used an innovative paradigm (adapted from Brunel, Labeye, Lesourd, & Versace, 2009) involving three phases: a learning phase, consisting in the categorization of geometrical shapes, which manipulated the rules of as...