Toolkit for animation of Finnish talking head

نویسندگان

  • Michael Frydrych
  • Jari Kätsyri
  • Martin Dobsík
  • Mikko Sams
چکیده

We have designed and implemented a toolkit for real-time animation of virtual 3D talking head, “Artificial Person”. Synchronized auditory and visual speech are automatically produced from input text, which can be enriched by user definable commands to perform specific gestures, as for example head nodding or facial expressions. The toolkit is extensible through external configuration files, so new actions can be quickly added. We have configured the Artificial Person to display facial expressions and phoneme articulations. Modular design of the toolkit allows to easily replace parts of the system or to detach and run them on different computers. Artificial Person can be used to produce controllable stimuli in psychophysical and neurophysiological research on audio-visual perception of speech and emotions.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Audio-visual speech synthesis for finnish

We describe our Finnish audio-visual speech synthesizer, its evaluation and discuss possible improvements. We have combined a three dimensional facial model with a commercial audio text-to-speech synthesizer. The visual speech is based on a letter-to-viseme mapping and the animation is created by linear interpolation between the visemes. An intelligibility test was run to quantify the benefit o...

متن کامل

Talking Head: Synthetic Video Facial Animation in MPEG-4

We present a system for facial modeling and animation that aims at the generation of photo-realistic models and performance driven animation. It is practical implementation of MPEG-4 compliant Synthetic Video Facial Animation pipeline (Simple and Calibration Profiles with some modifications), which includes: facial features recognition & tracking on real video sequence; obtaining, encoding, net...

متن کامل

Developing and Evaluating of Non- Realistic Three-Dimensional (3d-Nr) And Two-Dimensional (2d) Talking-Head Animation Courseware

The talking‐head animation is an instructional animation capable of improving the communication skills through enhancing the pronunciation skills; whereby a word is pronounced correctly and accurately. This had been proven by several researches, which indicate that learning with interactive animation is much more advantageous than conventional learning. Hence, the...

متن کامل

Evaluation of A Viseme-Driven Talking Head

This paper introduces a three-dimensional virtual head for use in speech tutoring applications. The system achieves audiovisual speech synthesis using viseme-driven animation and a coarticulation model, to automatically generate speech from text. The talking head was evaluated using a modified rhyme test for intelligibility. The audiovisual speech animation was found to give higher intelligibil...

متن کامل

The UWB 3d talking head text-driven system controlled by the SAT method used for the LIPS 2009 challenge

This paper describes the 3D talking head text-driven system controlled by the SAT (Selection of Articulatory Targets) method developed at the University of West Bohemia (UWB) that will be used for participation in the LIPS 2009 challenge. It gives an overview of methods used for visual speech animation, parameterization of a human face and a tongue, and a synthesis method. A 3D animation model ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2003