Toolkit for animation of Finnish talking head
نویسندگان
چکیده
We have designed and implemented a toolkit for real-time animation of virtual 3D talking head, “Artificial Person”. Synchronized auditory and visual speech are automatically produced from input text, which can be enriched by user definable commands to perform specific gestures, as for example head nodding or facial expressions. The toolkit is extensible through external configuration files, so new actions can be quickly added. We have configured the Artificial Person to display facial expressions and phoneme articulations. Modular design of the toolkit allows to easily replace parts of the system or to detach and run them on different computers. Artificial Person can be used to produce controllable stimuli in psychophysical and neurophysiological research on audio-visual perception of speech and emotions.
منابع مشابه
Audio-visual speech synthesis for finnish
We describe our Finnish audio-visual speech synthesizer, its evaluation and discuss possible improvements. We have combined a three dimensional facial model with a commercial audio text-to-speech synthesizer. The visual speech is based on a letter-to-viseme mapping and the animation is created by linear interpolation between the visemes. An intelligibility test was run to quantify the benefit o...
متن کاملTalking Head: Synthetic Video Facial Animation in MPEG-4
We present a system for facial modeling and animation that aims at the generation of photo-realistic models and performance driven animation. It is practical implementation of MPEG-4 compliant Synthetic Video Facial Animation pipeline (Simple and Calibration Profiles with some modifications), which includes: facial features recognition & tracking on real video sequence; obtaining, encoding, net...
متن کاملDeveloping and Evaluating of Non- Realistic Three-Dimensional (3d-Nr) And Two-Dimensional (2d) Talking-Head Animation Courseware
The talking‐head animation is an instructional animation capable of improving the communication skills through enhancing the pronunciation skills; whereby a word is pronounced correctly and accurately. This had been proven by several researches, which indicate that learning with interactive animation is much more advantageous than conventional learning. Hence, the...
متن کاملEvaluation of A Viseme-Driven Talking Head
This paper introduces a three-dimensional virtual head for use in speech tutoring applications. The system achieves audiovisual speech synthesis using viseme-driven animation and a coarticulation model, to automatically generate speech from text. The talking head was evaluated using a modified rhyme test for intelligibility. The audiovisual speech animation was found to give higher intelligibil...
متن کاملThe UWB 3d talking head text-driven system controlled by the SAT method used for the LIPS 2009 challenge
This paper describes the 3D talking head text-driven system controlled by the SAT (Selection of Articulatory Targets) method developed at the University of West Bohemia (UWB) that will be used for participation in the LIPS 2009 challenge. It gives an overview of methods used for visual speech animation, parameterization of a human face and a tongue, and a synthesis method. A 3D animation model ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003