We show that we can effectively fit complex animation models to noisy image data. Thus, complete head models can be acquired with a cheap and entirely passive sensor. The shape and motion parameters of limbs can be similarly captured and fed to existing animation software to produce synthetic sequences. In this paper, we show that we can effectively fit complex facial and body animation models ...

We propose an emotional facial avatar that portrays the user’s facial expressions with an emotional emphasis, while achieving visual and behavioral realism. This is achieved by unifying automatic analysis of facial expressions and animation of realistic 3D faces with details such as facial hair and hairstyles. To augment facial appearance according to the user’s emotions, we use emotional templ...

This paper presents a framework for performance-based animation and retargeting of high-resolution face models from motion capture. A novel method is introduced for learning a mapping between sparse 3D motion capture markers and dense high-resolution 3D scans of face shape and appearance. A high-resolution facial expression space is learnt from a set of 3D face scans as a person specific morpha...

Face expression recognition is useful for designing new interactive devices offering the possibility of new ways for human to interact with computer systems. In this paper we develop a facial expressions analysis and synthesis system. The analysis part of the system is based on the facial features extracted from facial feature points (FFP) in frontal image sequences. Selected facial feature poi...

The animation of synthetic faces is still a low-level process requiring much human expertise and hw/sw resources. The constraint-based facial animation editor system, FESINC, provides two kinds of support: allows the a-priory, declarative definition of dynamical expressions and requirements, and assures that while making the animation, these requirements are fulfilled. The novelty of the approa...

This report proposed an automatic face animation method. First, 28 features facial features are automatically extracted from the videorecorded face. Then, using a linear model, we can decompose the variation of the 28 facial features into the shape variation and the expression variation. Finally, the expression variation is used to control the animation of the target face. All the tracking and ...

Speech is produced by the vibration of the vocal cords and the configuration of the arti-culators. Because some of these articulators are visible, there is an inherent relationship between the acoustic and the visual forms of speech. This relationship has been historically used in lipreading. Today's advanced computer technology opens up new possibilities to exploit the correlation between acou...

This paper presents an efficient method to construct optimal facial animation blendshapes from given blendshape sketches and facial motion capture data. At first, a mapping function is established between “Marker Face” of target and performer by RBF interpolating selected feature points. Sketched blendshapes are transferred to performer’s “Marker Face” by using motion vector adjustment techniqu...

Generating extreme appearances such as scared awaiting sweating while happy fit for tears (cry) and blushing (anger and happiness) is the key issue in achieving the high quality facial animation. The effects of sweat, tears, and colors are integrated into a single animation model to create realistic facial expressions of 3D avatar. The physical properties of muscles, emotions, or the fluid prop...

Speech synchronized facial animation that controls only the movement of the mouth is typically perceived as wooden and unnatural. We propose a method to generate additional facial expressions such as movement of the head, the eyes, and the eyebrows fully automatically from the input speech signal. This is achieved by extracting prosodic parameters such as pitch flow and power spectrum from the ...