In this paper, we introduce an image processing tool, Video Spatialization, as a new approach to navigate through a “virtualized” scene, only known by a limited set of 2D uncalibrated images (i.e without any 3D CAD model). We develop this approach in the context of an interactive application: a multipoint teleconferencing system for very low bit rate links (internet, mobile communications), bas...

In this paper, we introduce an image processing tool, Video Spatialization, as a new approach to navigate through a “virtualized” scene, only known by a limited set of 2D uncalibrated images (i.e without any 3D CAD model). We develop this approach in the context of an interactive application: a multipoint teleconferencing system for very low bit rate links (internet, mobile communications), bas...

This paper examines the use of motion capture to control ambisonic spatialization and sound diffusion parameters in real time. The authors use several software programs, developed in Max, to facilitate the gestural control of spatialization. Motion tracking systems using cameras and peripheral devices such as the Leap Motion are explored as viable and expressive means to provide sound localizat...

The present paper is a shortened version of the one presented at the ICMC/SMC2014 [1] where it was demonstrated that SSMN (Spatialization Symbolic Music Notation) research seeks to establish a paradigm wherein OSC (Open Sound Control) [2] and a Rendering Engine allow a musical score to be heard in divers Surround formats. The research team consists of composers, spatialization experts, IT speci...

The translation of monophonic soundtracks to new audio formats is the object of a growing demand particularly from the DVD producers. However operations like “upmixing” a monophonic track to a multi-channel format are time-consuming tasks for the sound engineer, who has to choose, adapt and tune different spatialization tools. In order to simplify the upmix, we introduce a new spatialization ap...

As a collaboration with the Center for Research in Electronic Arts Technology (CREATE) at the University of California at Santa Barbara (UCSB), this thesis addresses sound spatialization in the AlloSphere, a research environment currently under construction as a shared facility of the California Nanosystems Institute and UCSB’s Media Arts and Technology program. This spherical construction, whi...

Interactive real-time spatialization of audio over large immersive speaker arrays poses significant interface and control challenges for live performers. Fluidly moving and mixing numerous sound objects over unique speaker configurations requires specifically designed software interfaces and systems. Currently available software solutions either impose configuration limitations, require extreme...

Human multimodal communicative behaviors form a tightly integrated whole. By matching up gestural features with a carefully time-tagged transcription of the speech, we can observe how gesture features and discourse unit transitions cohere. Space usage SU is a key gestural component. We summarize the theory of SU. In our experiments where subjects make action plans around a terrain map, such SU ...

This paper describes an application of constraint programming to interfaces for audio mixing. MidiSpace is an interface representing each sound source of a musical piece as a graphical icon, as well as an object corresponding to the listener in a window. MidiSpace is coupled to a spatialization system so that moving graphical objects modifies the audio mixing of the musical piece according to t...