This paper describes the design of SoniMime, a system for the sonification of hand movement for real-time timbre shaping. We explore the application of the tristimulus timbre model for the sonification of gestural data, working toward the goals of musical expressivity and physical responsiveness. SoniMime uses two 3-D accelerometers connected to an Atmel microprocessor which outputs OSC control...

The human ability to recognize, identify and compare sounds based on their approximation of particular vowels provides an intuitive, easily learned representation for complex data. We describe implementations of vocal tract models specifically designed for sonification purposes. The models described are based on classical models including Klatt[1] and Cook[2]. Implementation of these models in ...

Imagine a huge dataset of a public census or medical data or the worldwide Internet traffic. What do you hear? Obviously, we are not very familiar with the use of our listening capabilities when investigating large amounts of information! The typical data analyst is indeed confronted with large visual displays showing visualizations in front of a (concerning information value) rather silent com...

The migration of Pacific salmon is an important part of functioning freshwater ecosystems, but as populations have decreased and ecological conditions have changed, so have migration patterns. Understanding how the environment, and human impacts, change salmon migration behavior requires observing migration at small temporal and spatial scales across large geographic areas. Studying these detai...

In this paper we present an approach that enables visually impaired people to explore multivariate data through scatter plots. Our approach combines Tangible Active Objects (TAOs) [1] and Interactive Sonification [2] into a non-visual multi-modal data exploration interface and thereby translates the visual experience of scatter plots into the audio-haptic domain. Our system and the developed so...

Medical image data has traditionally been analyzed using visual displays and statistical analysis methods. Visual representations are limited due to the nature of the display and the number of dimensions that can be represented visually. This paper describes the use of sonification to represent medical image data of brain scans of patients with AlzheimerÕs dementia. The use of sonification is d...

Two sonification tools are presented for use in calculus instruction. The first is a web-based tool for teaching students to interpret sonifications. The other is a spreadsheet-based tool that uses sonification to support and reinforce graphical and numeric representations of functions. We also illustrate how the tools could be used, and present data on the usability of the tools and the abilit...

The field of physiology-based interaction and monitoring is developing at a fast pace. Emerging applications like fatigue monitoring often use sound to convey complex dynamics of biological signals and to provide an alternative, non-visual information channel. Most Physiology-to-Sound mappings in such auditory displays do not allow customization by the end-users. We designed a new sonification ...

This paper introduces kernel regression mapping sonification (KRMS) for optimized mappings between data features and the parameter space of Parameter Mapping Sonification. Kernel regression allows to map data spaces to highdimensional parameter spaces such that specific locations in data space with pre-determined extent are represented by selected acoustic parameter vectors. Thereby, specifical...

Information sonification is an emerging field of pervasive computing and is applicable in many wearable artificial sensory systems. This paper presents some strategies that can be employed in auditory interface design where using sound as representation gives insight into the improvement of comprehension and recognition of information sonification in an auditory graphing system. The design stra...