Vision-based human affect analysis is an interesting and challenging problem, impacting important applications in many areas. In this paper, beyond facial expressions, we investigate affective body gesture analysis in video sequences, a relatively understudied problem. Spatial-temporal features are exploited for modeling of body gestures. Moreover, we present to fuse facial expression and body ...

A facial gesture analysis procedure is presented for the control of animated faces. Facial images are partitioned into a set of local, independently actuated regions of appearance change termed co-articulation regions (CRs). Each CR is parameterized by the activation level of a set of face gestures that affect the region. The activation of a CR is analyzed using independent component analysis (...

In this paper, the facial expression communication is mainly focused to achieve the smooth telecommunications. The gesture and facial expressions has been considered as signi cant factors in telecommunications, such as tele-services. To realize the real time communication system on facial expression, we proposed the facial expression space (FES) and a correspondence technique between each perso...

Speakers often anticipate how recipients will interpret their utterances. If they wish some other, less obvious interpretation, they may 'mark' their utterance (e.g. with special intonations or facial expressions). We investigated whether two- and three-year-olds recognize when adults mark a non-verbal communicative act--in this case a pointing gesture--as special, and so search for a not-so-ob...

Our aim is to create an affective Embodied Conversational Agent (ECA); that is an ECA able to display communicative and emotional signals. Nonverbal communication is done through certain facial expressions, gesture shapes, gaze direction, etc. But it can also carry a qualitative aspect through behavior expressivity: how a facial expression, a gesture is executed. In this paper we describe some ...

Designing affective user interfaces involving expressive characters raises several questions. The system should be able to display facial expressions of complex emotions as dynamic and realtime reactions to user’s inputs. From a cognitive point of view, designers need to know how the user will perceive the dynamics of these facial expressions as a function of his/her input. We aim at evaluating...

Recently the sign-language communication systems between avatars of different languages have been investigated as a means of overcoming the linguistic barrier. In the systems, an intelligent communication method has been employed, where sets of the animation parameters such as the joint angles of the gesture were transmitted instead of sending the entire-real motion pictures. However, the commu...

Designing affective user interfaces involving expressive characters raises several questions. The system should be able to display facial expressions of complex emotions as dynamic and realtime reactions to user’s inputs. From a cognitive point of view, designers need to know how the user will perceive the dynamics of these facial expressions as a function of his/her input. We aim at evaluating...