The authors present a new method of recognizing different human facial gestures through their neural activities and muscle movements, which can be used in machine-interfacing applications. Human-machine interface (HMI) technology utilizes human neural activities as input controllers for the machine. Recently, much work has been done on the specific application of facial electromyography (EMG)-b...

The last few years have seen great maturation in using computer graphics to portray 3D embodied virtual agents. Unlike the off-line, animator-intensive methods used for special effects, real-time embodied agents are expected to interact with us “live.” They can represent other people in a live VR environment such as autonomous helpers, teammates, or tutors and thus enable novel interactive educ...

We propose a novel and unified Cycle In Generative Adversarial Network (C2GAN) for generating human faces, hands, bodies, natural scenes. Our proposed C2GAN is cross-modal model exploring joint exploitation of the input image data guidance in an interactive manner. contains two different generators, i.e., image-generation generator guidance-generation generator. Both generators are mutually con...

Sign language is a produced by body parts gestures and facial expressions. The aim of an automatic sign recognition system to assign meaning each gesture. Recently, several computer vision systems have been proposed for using variety techniques, languages, gesture modalities. However, one the challenging problems involves image preprocessing, segmentation, extraction tracking relevant static dy...

One of the challenges of designing virtual humans is the definition of appropriate models of the relation between realistic emotions and the coordination of behaviors in several modalities. In this paper we present the annotation, representation and modeling of multimodal visual behaviors occurring during complex emotions. We illustrate our work using a corpus of TV interviews. This corpus has ...

Augmenting human computer interaction with automated analysis and synthesis of facial expressions is a goal towards which much research effort has been devoted

ext communication is often perceived as lacking some components of communication that are essential in sustaining interaction or conversation. This interaction incoherency tends to make text communication plastic. It is traditionally devoid of intonation, pitch, gesture, facial expression and visual or auditory cues. Nevertheless, Instant Messaging (IM), a form of text communication is on the u...