SonART is a flexible, multi-purpose multimedia environment that allows for networked collaborative interaction with applications for art, science and industry. In this paper we describe the integration of image and audio that SonART enables. An arbitrary number of layered canvases, each with independent control of opacity, RGB values, etc., can transmit or receive data using Open Sound Control....

Dynamic range limitations in signal processing often lead to clipping, or saturation, signals. The task of audio declipping is estimating the original signal, given its clipped measurements, and has attracted much interest recent years. Audio algorithms make assumptions about underlying such as sparsity low-rankness, measurement system. In this paper, we provide an extensive review proposed lit...

This paper is about the role of the operating system (OS) within computer nodes of network audio systems. While many efforts in the network-audio community focus on low-latency network protocols, here we highlight the importance of the OS for network audio applications. We present Tessellation, an experimental OS tailored to multi-core processors. We show how specific OS features, such as guara...

This paper proposes robust methods for processing EMG (electromyography) signals in the framework of audio-EMGbased speech recognition. The EMG signals are captured when uttered and used as auxiliary information for recognizing speech. Two robust methods (Cepstral Mean Normalization and Spectral Subtraction) for EMG signal processing are investigated to improve the recognition performance. We a...

This paper is about the role of the operating system (OS) within computer nodes of network audio systems. While many efforts in the network-audio community focus on low-latency network protocols, here we highlight the importance of the OS for network audio applications. We present Tessellation, an experimental OS tailored to multicore processors. We show how specific OS features, such as guaran...

Multidimensional-adaptive audio coding algorithms can adapt multiple performance measures to the demands of different audio applications in real-time. Depending on the transmission or storage environment, audio processing applications require forms of error control to maintain acceptable audio quality. By definition, multidimensional-adaptive audio coding utilizes numerous error detection, corr...

In audio applications it is often necessary to process the signal in “real time”. The method of segmented wavelet transform (SegWT) makes it possible to compute the discrete-time wavelet transform of a signal segment-by-segment, not using the classical “windowing”. This means that the method could be utilized for wavelettype processing of an audio signal in real time, or alternatively in case w...

In this paper, we present some novel methods and applications for audio and video signal processing for a multimodal environment of an assisted living smart space. This intelligent environment was developed during the 7th Summer Workshop on Multimodal Interfaces eNTERFACE. It integrates automatic systems for audio and video-based monitoring and user tracking in the smart space. In the assisted ...

The decomposition of audio signals into perceptually meaningful modulation components is highly desirable for the development of new audio effects on the one hand and as a building block for future efficient audio compression algorithms on the other hand. In the past, there has always been a distinction between parametric coding methods and waveform coding: While waveform coding methods scale e...

There are typically four steps in producing a CD or movie soundtrack, as shown in Figure . In tracking sounds are recorded or synthesized and arranged in tracks. The tracks are then processed in the mixing stage to form a stereo or multichannel mix. The idea is to arrange the sounds spatially and spectrally, to manipulate their character for artistic purposes, and also to fix problems in the tr...