A new technique for automated classification of human hand gestures for robotics and computer control applications is presented. It uses view-based approach for representation, and statistical technique for classification. This approach uses a cumulative image-difference technique where the time between the sequences of images is implicitly captured in the representation of action. This results...

Automatic sign language recognition is a challenging task in machine learning and computer vision. Most works have focused on recognizing using hand gestures only. However, body motion facial play an essential role interaction. Taking this into account, we introduce automatic system based multiple gestures, including hands, body, face. We used depth camera (OAK-D) to obtain the 3D coordinates o...

This paper presents the multimodal corpora that are being collected and annotated in the Nordic NOMCO project. The corpora will be used to study communicative phenomena such as feedback, turn management and sequencing. They already include video material for Swedish, Danish, Finnish and Estonian, and several social activities are represented. The data are being annotated following an annotation...

In this paper, we present a face and gesture based human computer interaction (HCI) system. We combine head pose and hand gesture to control the system. We can identify the positions of the eyes and mouth, and use the face center to estimate the pose of the head. Moreover, we introduce a technique for automatic gesture area segmentation and orientation normalization of the hand gesture. The use...

Preliminary work on real-time hand-gesture recognition for SAVI (Stereo Active Vision Interface) is introduced. Based on the detection of frontal faces, image regions near the face are searched for the existence of skin-tone blobs. Each blob is evaluated to determine if it is a hand held in a standard pose. A verification algorithm based on the responses of elongated oriented filters is used to...

Humans often use hand gestures to instruct other persons, e.g., to grasp an object or to look at a certain location. Especially in assembly tasks pointing gestures can simplify the cooperation between man and machine. We use visual attention to control the active cameras of our system to xate interesting image regions, e.g., assembly parts. Furthermore, the system reacts on the appearance of hu...

The creation of conversational agents capable of expressive and communicative behaviors requires to define the relationship between the agent’s communicative intentions and how these intentions are expressed in a coordinated verbal and nonverbal message. Suppose an agent S (a Sender) has the goal of communicating something to an interlocutor A (Addressee) in a particular situation and context; ...