We propose a new general approach to the problem of head pose estimation, based on semi-supervised low-dimensional topographic feature mapping. We show how several recently proposed nonlinear manifold learning methods can be applied in this general framework, and additionally, we present a new algorithm, IsoScale, which combines the best aspects of some of the other methods. The efficacy of the...

Facial Expression gives important information about emotion of a person. Face emotion recognition is one of main applications of machine vision that widely attended in recent years. It can be used in areas of security, entertainment and human machine interface (HMI). Emotion recognition usually uses of science image processing, speech processing, gesture signal processing and physiological sign...

We propose a region-based method for model-free object tracking. In our method the object information of temporal motion and spatial luminance are fully utilized. We first compute dominant motion of the tracked object. Using this result we warp the object template to generate a prediction template. Static segmentation is incorporated to modify this prediction, where the warping error of each wa...

We describe a framework for constructing a model of emotions and personality for a computational agent. The architecture uses dynamic models of emotions and personality encoded as Bayesian networks to 1) diagnose the emotions and personality of the user, and 2) generate appropriate behavior by an automated agent. Classes of interaction that are interpreted and/or generated include such things a...

Facial expressions of emotions are often described statically at their apex. Lately several researchers (Keltner, 1995) have shown through analysis of video corpora that emotions are expressed through a sequence of micro-behaviours. These micro-behaviours correspond to signals spread over the whole body (face, head, gaze, gesture, etc). All these signals do not have to occur simultaneously. Som...

MagiCster is concerned with the development of believable conversational interface agents which make use of gaze, facial expression, gesture and body posture as well as speech in a synchronised fashion. The project is evaluating the use of conversational agents in laboratory conditions to determine which aspects are important for what types of human-computer interactions. The project also aims ...

Conversational agents are supposed to combine speech with non-verbal modalities for intelligible multimodal utterances. In this paper, we focus on the generation of gesture and speech fromXML-based descriptions of their overt form. An incremental production model is presented that combines the synthesis of synchronized gestural, verbal, and facial behaviors with mechanisms for linking them in f...

We present a new coding mechanism, spatiotemporal coding, that allows coders to annotate points and regions in the video frame by drawing directly on the screen. Coders can not only attach labels to time intervals in the video but can specify a possibly moving region on the video screen. This opens up the spatial dimension for multi-track video coding and is an essential asset in almost every a...

While children’s acquisition of lexically encoded politeness formulas has been investigated to a certain extent, little is known about their sensitivity to prosody and facial expressions as cues to politeness. The goal of this paper is to test the ability of 3-year-old American English-speaking children to recognize a speaker’s polite stance in their native language based on prosodic and facial...

Body language is widely used as a kind of means nonverbal communication. Not only can it help people express their thoughts and feelings, but also transmit all kinds communicating information. This paper discusses the significance body by analyzing difference in meaning cross-cultural communication several typical behaviors. Firstly, first part gives brief introduction language, including its d...