Interactive sonification of German wheel sports movements

نویسنده

  • Jessica Hummel
چکیده

This paper presents the design, implementation and evaluation of a sonification system, which gives real-time auditory feedback to a performer who is carrying out moves on sports equipment called a German wheel. The paper starts with a brief description of different German wheel move categories and of relevant research on movement sonification to present how these motivated some of our design decision. Thereafter the structure and functionality of the sonification system, which is implemented in the programming language SuperCollider is discussed, including its division into three sub-tasks. These sub-tasks are data acquisition, feature extraction and sonification. The data acquisition uses a magnetometer to collect data about the motion of the wheel. By measuring the magnetic field of the earth, it acts similar to a compass and allows to determine the orientation of the wheel. This orientation is one of the main features that are derived from the input data in the feature extraction process. A set of further features is derived from the input data and the orientation of the wheel. The choice of these features was inspired by the background knowledge about the different wheel move categories and accordingly the task a performer who is using the wheel is confronted with. Finally the system uses the features to produce an acoustic representation of the motion. We implemented four different sonifications: the Direct-data sonification, Cartoonification, Vowel synthesis sonification and Event-based sonification. The Direct-data sonification uses the unprocessed input data to generate an acoustic feedback, which leaves the interpretation completely to the user. The Cartoonification uses some of the features to imitate and amplify a natural rolling sound. The Vowel synthesis represents the motion of the wheel through synthetic vowel sounds. The idea is based on the thought that

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Sonified Aerobics – Interactive Sonification of Coordinated Body Movements

This paper introduces a new hard-/ and software system for the interactive sonification of sports movement involving armand leg movements. Two different sonifications are designed to convey rhythmical patterns that become auditory gestalt so that listeners can identify features of the underlying coordinated movement. The Sonification is designed for the application to enable visually impaired u...

متن کامل

Wearable Setup for Gesture Andmotion Based Closed Loop Audio Interaction

The wearable sensor and feedback system presented in this paper is a type of audio-haptic display which contains onboard sensors, embedded sound synthesis, external sensors, and on the feedback side a loudspeaker and several vibrating motors. The so called “embedded sonification” in this case here is an onboard IC, with implemented sound synthesis. These are adjusted directly by the user and/or...

متن کامل

New Directions for Sonification of Expressive Movement in Music

Expert musical performance is rich with movements that facilitate performance accuracy and expressive communication. As in sports or rehabilitation, these movements can be sonified for analysis or to provide realtime feedback to the performer. Expressive movement is different however in that movements are not strictly goaloriented and highly idiosyncratic. Drawing upon insights from the literat...

متن کامل

Sonification as Catalyst in Training Manual Wheelchair Operation for Sports and Everyday Life

In this paper, a study on sonification of manual wheelchair movements is presented. The aim was to contribute to both rehabilitation contexts and in wheelchair sports contexts, by providing meaningful auditory feedback for training of manual wheelchair operation. A mapping approach was used where key parameters of manual wheelchair maneuvering were directly mapped to different sound models. The...

متن کامل

Developing a dancer sonification system using the Immersive Interactive Sonification Platform (iISoP)

For decades, researchers have spurred research on sonification, the use of non-speech audio to convey information. As the level of automation increases in the workplace, monitoring the state and performance of complex systems can require more cognitive resources than provided through visual information processing channels. In recent years interactive sonification and gesture-based interaction h...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2009