This paper is a review of the audio rendering capabilities in the MPEG-4 standard. The basic model for describing the audiovisual scene in MPEG-4 is the scene graph (BIFS), which is based on the VRML model. MPEG-4 extends the model with a quite complete acoustics modeling framework. The different versions of the standard are discussed as well as the different approaches (physical and perceptual...

A real-time virtual audio reality model has been created. The system includes model-based sound synthesizers, geometric room acoustics modeling, binaural auralization for headphone or loudspeaker listening, and high-quality animation. The design goals of the overall project have been to create a virtual musical event that is as authentic as possible both in terms of audio and visual quality. No...

This paper examines the problem of estimating stream weights for a multistream audio-visual speech recogniser in the context of a simultaneous speaker task. The task is challenging because signalto-noise ratio (SNR) cannot be readily inferred from the acoustics alone. The method proposed employs artificial neural networks (ANNs) to estimate the SNR from HMM state-likelihoods. SNR is converted t...

Existing real-time audio rendering architectures provide rigid development frameworks which are not adapted to a wide range of applications. In particular, experimenting with new rendering techniques is virtually impossible. In this paper, we present a novel, platform-independent software architecture that is well suited for experimenting with multichannel audio mixing, geometrical acoustics an...

Aalto University, P.O. Box 11000, FI-00076 Aalto www.aalto.fi Author Jukka S. Keränen Name of the doctoral dissertation Measurement and Prediction of the Spatial Decay of Speech in Open-Plan Offices Publisher School of Electrical Engineering Unit Department of Signal Processing and Acoustics Series Aalto University publication series DOCTORAL DISSERTATIONS 23/2015 Field of research Acoustics an...

Approaches to audio classification and retrieval tasks largely rely on detectionbased discriminative models. We submit that such models make a simplistic assumption in mapping acoustics directly to semantics, whereas the actual process is likely more complex. We present a generative model that maps acoustics in a hierarchical manner to increasingly higher-level semantics. Our model has two laye...

Interactive environmental audio spatialization technology has become commonplace in personal computers and is migrating into portable entertainment platforms (including cell phones) and multiplayer game servers (virtual online worlds). While the primary current application of this technology is 3D game sound track rendering, it is ultimately necessary in the implementation of any personal or sh...

AARAE is a MATLAB-hosted environment for measurement and analysis of room acoustics and audio systems, designed to support education and research in audio and acoustics. While it already provides a wide range of test signals, and measurement, processing, and analysis methods, one of its main features is easy extensibility. Students new to signal processing (and MATLAB) can use it from its graph...

– The main idea of this work is based on the following philosophy: To achieve the ideal compression of audio and video information, utilize the algorithm of information processing intrinsic in the human audio and video systems. In our work, using the results of physiology, musical acoustics and video perception theory, we show that the model of audio and video information processing can be desc...