In this paper, we present a real-time facial animation system in which speech drives mouth movements and facial expressions synchronously. Considering five basic emotions, a hierarchical structure with an upper-layer of emotion classification is established. Based on the recognized emotion label, the under-layer classification at sub-phonemic level has been modelled on the relationship between ...

In this study, we combined physically-based modeling and parameterization to generate realistic speech animation on synthetic faces. We used physically-based modeling for muscles. Muscles are modeled as forces deforming the mesh of polygons. Parameterization technique is used for generating mouth shapes for speech animation. Each meaningful part of a text,which is a letter in our case,correspon...

We propose a novel approach based on machine learning to simulate facial expressions related to physical activity. Because of the various factors they involve, such as psychological and biomechanical, facial expressions are complex to model. While facial performance capture provides the best results, it is costly and difficult to use for real-time interaction during intense physical activity. A...

Facial animation has reached a high level of photorealism. Skin is rendered with grain and translucency, wrinkles are accurate and dynamic. These recent visual improvements are not fully tested for their contribution to the perceived expressiveness of virtual characters. This paper presents a perceptual study assessing the impact of different rendering modes of expressive wrinkles on users’ per...

In this paper, we applied local warping techniques to construct a frame work of image-based morphing for facial expressions animation with low complexity. From the experience we obtained in various spatial transformations, the local warping methods are more adequate for facial expressions morphing. We utilized two transformations that can deal with local deformations: piecewise polynomial trans...

This paper describes the synthesis of sign-language animation for mobile environments. Sign language is synthesized by using either the motion-capture or motion-primitive method. An editing system can add facial expressions, mouth shapes and gestures to the sign-language CG animation. Sign-language animation is displayed on PDA screens to inform the user of his/her mobile environment.

This paper presents a hybrid method for synthesizing natural animation of facial expression with data from motion capture. The captured expression was transferred from the space of source performance to that of a 3D target face using an accurate mapping process in order to realize the reuse of motion data. The transferred animation was then applied to synthesize the expression of the target mod...

Facial animation is traditionally considered as important but tedious work for most applications, because the muscles on the face are complex and dynamically interacting. Although there are several methods proposed to ease the burden from artists to create animating faces, non of them are fast and efficient in storage. In this paper, we introduce a framework for synthesizing lips-sync facial an...

In this paper an interactive facial animation system is described The system is built on top of the facial animation system developed by Keith Waters which uses a muscle based face model We built an interactive facial animation system on top of it to produce keyframe animations of a synthetic face model The user creates keyframes interactively by either giving prede ned universal expressions to...

We introduce a method for learning a mapping between signals, and use this to drive facial animation directly from vocal cues. Instead of depending on heuristic intermediate representations such as phonemes or visemes, the system learns its own representation, which includes dynamical and contextual information. In principle, this allows the system to make optimal use of context to handle ambig...