In this paper, we propose a multi-modal voice activity detection system (VAD) that uses audio and visual information. Audioonly VAD systems typically are not robust to (acoustic) noise. Incorporating visual information, for example information extracted from mouth images, can improve the robustness since the visual information is not affected by the acoustic noise. In multi-modal (speech) signa...

This chapter is about the estimation of multiple fundamental frequencies (F0) from a waveform such as the compound sound of several people speaking at the same time, or several musical instruments playing together. That information may be needed to transcribe the music to a score, to extract intonation patterns for speech recognition, or as an ingredient for computational auditory scene analysi...

There is evidence that the right hemisphere is involved in processing self-related stimuli. Previous brain imaging research has found a network of right-lateralized brain regions that preferentially respond to seeing one's own face rather than a familiar other. Given that the self is an abstract multimodal concept, we tested whether these brain regions would also discriminate the sound of one's...

Adults diagnosed with autism spectrum disorder (ASD) show a reduced sensitivity (degree of selective response) to social stimuli such as human voices. In order to determine whether this reduced sensitivity is a consequence of years of poor social interaction and communication or is present prior to significant experience, we used functional MRI to examine cortical sensitivity to auditory stimul...

A poster presentation at XVIII PVSF/UCLA Pacific Voice Conference on work in progress. European Union representatives in the COST action on advanced voice assessment: Mette Pedersen MD, PhD, et h.c. Ear‐nose‐throat specialist, FRSM. Anna Barney, PhD, Senior Lecturer at the Institute of Sound and Vibration Research, University of Southampton, UK. Jointly chaired a special session on advanced vo...

Phonagnosia, the inability to recognize familiar voices, has been studied in brain-damaged patients but no cases due to developmental problems have been reported. Here we describe the case of KH, a 60-year-old active professional woman who reports that she has always experienced severe voice recognition difficulties. Her hearing abilities are normal, and an MRI scan showed no evidence of brain ...

In this paper, we investigate the acoustic features that can be modified to control the perceptual age of a singing voice. Singers can sing expressively by controlling prosody and vocal timbre, but the varieties of voices that singers can produce are limited by physical constraints. Previous work has attempted to overcome this limitation through the use of statistical voice conversion. This tec...

Functional magnetic resonance imaging studies have repeatedly provided evidence for temporal voice areas (TVAs) with particular sensitivity to human voices along bilateral mid/anterior superior temporal sulci and superior temporal gyri (STS/STG). In contrast, electrophysiological studies of the spatio-temporal correlates of cerebral voice processing have yielded contradictory results, finding t...

This chapter is about the estimation of multiple fundamental frequencies (F0) from a waveform such as the compound sound of several people speaking at the same time, or several musical instruments playing together. That information may be needed to transcribe the music to a score, to extract intonation patterns for speech recognition, or as an ingredient for computational auditory scene analysi...