Multimodal communication involves multiple communicative channels including speech, facial movement, and gesture. Relatively few studies on how various communicative modalities are aligned in natural, face-to-face communication exist. As part of a larger project, the current study investigates how discourse structure, speech features, eye gaze, and facial movements interrelate during a map coor...

The central role of the face in social interaction and non-verbal communication suggest we explore facial action as a means of musical expression. This paper presents the design, implementation, and preliminary studies of a novel system utilizing face detection and optic flow algorithms to associate facial movements with sound synthesis in a topographically specific fashion. We report on our ex...

Non-verbal communication may be used to enhance verbal communication or even provide developers with an alternative for communicating information. Emotion or Gesture recognition is been highlighted in the area of Artificial Intelligence and advanced machine learning. Emotion or gesture is an important feature for an intelligent Human Computer Interaction. This paper basically is a literature su...

Social robotics is related to the robotic systems and human interaction. Social robots have applications in elderly care, health care, home care, customer service and reception in industrial settings. Human-Robot Interaction (HRI) requires better understanding of human emotion. There are few multimodal fusion systems that integrate limited amount of facial expression, speech and gesture analysi...

In the field of image processing it is very interesting to recognize the human gesture for general life applications. For example, observing the gesture of a driver when person is driving and alerting the person when in sleepy mood will be quite useful. Human gestures can be identified by observing the different movements of eyes, mouth, nose and hands. In this proposed system it is focusing on...

Avatars are increasingly used to express our emotions in our online communications. Such avatars are used based on the assumption that avatar expressions are interpreted universally among any cultures. However, our former studies showed there are cultural differences in interpreting avatar facial expressions. This paper summarizes the results of the former studies of cross cultural evaluations ...

Dr. A. K. Deshmane Principal, JSPM’S, B.I.T,, Bharshi (Maharashtra), India Abstract— Emotion of a person plays important role in life because we cannot express our feelings or emotions in words, facial expression or gesture to express emotions. A human face does not only identify an individual but also communicates useful information about a person’s emotional state. Facial Expression gives imp...

Avatars are increasingly used to express our emotions in our online communications. Such avatars are used based on the assumption that avatar expressions are interpreted universally among any cultures. However, our former study showed there are cultural differences in interpreting avatar facial expressions. This paper summarizes the results of cross cultural evaluations of avatar expressions am...

People natural ly express themselves through facial gestures. We have implemented an interface that tracks a person's facial features robustly in real t ime (30Hz) and does not require art i f icial artifacts such as special i l lumination or facial makeup. Even if features become occluded the system is capable of recovering tracking in a couple of frames after the features reappear in the imag...

People naturally express themselves through facial gestures. We have implemented an interface that tracks a person's facial features robustly in real time (30Hz) and does not require artiicial artifacts such as special illumination or facial makeup. Even if features become occluded the system is capable of recovering tracking in a couple of frames after the features reappear in the image. Based...