We present a novel methodology for building highly integrated multimodal systems. Our approach is motivated by neurological and behavioral theories of sensory perception in humans and animals. We argue that perceptual integration in multimodal systems needs to happen at all levels of the individual perceptual processes. Rather than treating each modality as a separately processed, increasingly ...

The approach taken in this research is to develop a cognitive model of how a human observerr extracts dmcl-The information from a visual display and then uses this perceptual information in a decision-making task. Knowledge ~ e e about this relationship provides information about the occurrence of perceptual events in the course of problemsolving activities, and suggests that perceptual assista...

The latest High Efficiency Video Coding (HEVC) standard significantly improves coding efficiency over its previous video coding standards. The expense of such improvement is enormous computational complexity, from both encoding and decoding sides. Since computational capability and power capacity are diverse across portable devices, it is necessary to reduce decoding complexity to a target with...

the study of the sign, in transition from the structural semiotic and narrative system, has entered a new area called the discursive sign-semantics. the first phase is based on the contrasting relations between semantic poles and the second is based on the program and transformation from the first condition to the second. however, this new approach, influenced by phenomenology, has opened a new...

Behavior is organized into stable action modes with qualitative transitions between them. An ecological approach attempts to account for these patterns in terms of physical and informational constraints, such as attractors in the underlying dynamics of action and perceptual information specific to them. Perception and action are coupled by laws of control that relate informational variables to ...

This letter presents a novel frame splitting scheme for an error-robust audio streaming over packet-switching networks. In our approach to perceptual audio coding, an audio frame is split into several subframes based on the network configuration such that each packet can be decoded independently at the receiver. Through a subjective comparison category rating (CCR) test, it is discovered that o...

This paper describes the approach to the assessment of the naturalness of synthetic speech taken within the ProSynth collaborative speech synthesis project. The view expressed is that an important aspect of naturalness is ease of understanding, and the consequences are that this leads to a means for the evaluation of scientific hypotheses through perceptual tests. The premise within ProSynth is...