Speech, for most of us, is a bimodal percept whenever we both hear the voice and see the lip movements of a speaker. Children who are born deaf never have this bimodal experience. We tested children who had been deaf from birth and who subsequently received cochlear implants for their ability to fuse the auditory information provided by their implants with visual information about lip movements...

Open Access Full open access to this and thousands of other papers at The recently published article by Wang, 1 and commented on by Ertel 2 in this journal, describes development of a method, named the Bimodality Index, to objectively identify and rank meaningful and reliable bimodal patterns from large-scale gene expression datasets. This is an important step because genes with a bimodal distr...

Analog optical solutions of numerical problems tend to be fast, simple, and inaccurate. Digital optical or electronic solutions to the same problems tend to be slower, harder, and more accurate. In circumstances outlined here, hybrid analog-digital systems can be built which give the accuracy of digital solutions with intermediate degrees of speed and simplicity. Because at any instant these pr...

OBJECTIVES Despite excellent performance in speech recognition in quiet, most cochlear implant users have great difficulty with speech recognition in noise, music perception, identifying tone of voice, and discriminating different talkers. This may be partly due to the pitch coding in cochlear implant speech processing. Most current speech processing strategies use only the envelope information...

Mergers of globular clusters (GCs) once associated with dwarf spheroidal (dSph) galaxies have recently been suggested as an explanation for the bimodal horizontal branches (HBs) of some Galactic GCs, most notably NGC 1851, NGC 2808, and NGC 6229. Through analysis of the available color-magnitude diagrams for the GCs in the Fornax and Sagittarius dSph satellites of the Milky Way, as well as thei...

This paper presents a bimodal acoustic-visual synthesis technique that concurrently generates the acoustic speech signal and a 3D animation of the speaker’s outer face. This is done by concatenating bimodal diphone units that consist of both acoustic and visual information. In the visual domain, we mainly focus on the dynamics of the face rather than on rendering. The proposed technique overcom...

This paper introduces incoming evaluation frameworks for bimodal speech recognition in noisy conditions and real environments. In order to develop a robust speech recognition in noisy environments, bimodal speech recognition which uses acoustic and visual information has been paid attention to particularly for this decade. As a lot of methods and techniques for bimodal speech recognition have b...

Recent technological advances have enabled human users to interact with computers in ways previously unimaginable. Beyond the confines of the keyboard and mouse, new modalities for human-computer interaction such as voice, gesture, and force-feedback are emerging. Despite important advances, one necessary ingredient for natural interaction is still missing emotions. This paper describes the cha...

We present a biologically inspired active vision system that incorporates two modes of perception. A peripheral mode provides a broad and coarse perception of where mass is in the scene in the vicinity of the current fixation point, and how that mass is moving. It involves fusion of actively acquired depth data into a 3D occupancy grid. A foveal mode then ensures coordinated stereo fixation upo...