Traditional uses of virtual audio environments tend to focus on perceptually accurate acoustic representations. Though spatialization of sound sources is important, it is necessary to leverage control of the sonic representation when considering musical applications. The proposed framework allows for the creation of perceptually immersive scenes that function as musical instruments. Loudspeaker...

As people try to cope with massive amounts of electronic infoffi1ation, browsing through very large archives can frustrate and eventually impede the retrieval of infoffi1ation. The paper presents an approach to search catalogs of very large electronic archives, that combines computer visualization with the descriptive and analytical power of geography. This method is called "spatialization", re...

Human multimodal communicative behaviors form a tightly integrated whole. By matching up gestural features with a carefully time-tagged transcription of the speech, we can observe how gesture features and discourse unit transitions cohere. Space usage SU is a key gestural component. We summarize the theory of SU. In our experiments where subjects make action plans around a terrain map, such SU ...

SPAT-SCENE is a graphical user interface and spatial sound processor embedded in computer-aided composition software. It combines the interface and the rendering engine of Ircam Spatialisateur with a compositional and temporal control of spatial scene descriptors. Previous studies of the composition process as well as interviews with the composers themselves emphasized the needs for tools integ...

BioRhythm is an interactive bio-feedback installation controlled by the cardiovascular system. Data from a photoplethysmograph (PPG) sensor controls sonification and visualization parameters in real-time. Biological signals are obtained using the techniques of Resonance Theory in Hemodynamics and mapped to audiovisual cues via the Five Element Philosophy. The result is a new media interface uti...

This paper addresses the problem of recovering spatial cues after microphone array processing by blind source separation. Based on the known demixing system determined by the blind source separation, we derive two spatialization algorithms. One algorithm exploits the inverse of the demixing system, while the other algorithm exploits the adjoint of the demixing system. Both algorithms are evalua...

This paper outlines the requirements for an interchange format that can describe and share spatial parameters across 3D audio applications, and proposes SpatDIF for its implementation. 1. WHY USING A SCENE DESCRIPTION FORMAT FOR COMPOSING? Formats as a structuring concept are integral to musical practice. For example, in the form of scores, a written symbolic representation of music, compositio...

Data visualization has become an important tool for analyzing very complex data. In particular, spatial visualization enables users to view data in a intuitive manner. It has typically been used to externalize clusters and their relationships which exist in highly complex multidimensional data. We envisage that not only cluster formation and relationships but also other types of information, su...