An important feature of speech-gesture integration is that speech and gesture content influence each other in interpretation. To analyse this, we sketch an approach based on three assumptions: (i) the interpreter infers by abduction an explanation for why a particular gesture is synchronized with a particular utterance (part), (ii) semantic composition amounts to the identification of free vari...

In order to produce a coherent narrative, speakers must identify the characters in the tale so that listeners can figure out who is doing what to whom. This paper explores whether speakers use gesture, as well as speech, for this purpose. English speakers were shown vignettes of two stories and asked to retell the stories to an experimenter. Their speech and gestures were transcribed and coded ...

As per the rapidly advancement in the changing technology, the numerous applications are required. For example, for face, hand and gesture recognition. The previous researchers have been developed various methods foe head gesture recognition and they presented various limitations. Therefore the paper proposes an FPGA based gesture recognition system. The gesture detection and gesture recognitio...

This article describes a first version of a system for translating speech into Spanish Sign Language. The system proposed is made up of 4 modules: speech recognizer, semantic analysis, gesture sequence generation and gesture playing. For the speech recognizer and the semantic analysis, we use modules developed by IBM and the University of Colorado respectively. The gesture sequence generation u...

The aim of this article is to provide clinicians and researchers a comprehensive overview of the development and functions of gesture in childhood and in select populations with developmental language impairments. Of significance is the growing body of evidence that gesture enhances, not hinders, language development. In both normal and impaired populations, gesture and language development par...

Human centered human-computer interaction technology tends to replace the traditional computer centered technology with its growing applicability to a wide variety of applications. Acting as a way of most natural communication between human and machine, vision based hand gesture recognition is becoming the pursuit of human-computer interaction. General vision based hand gesture recognition gene...

When people talk they gesture, and those gestures often reflect thoughts not expressed in their words. In this sense, gesture and the speech it accompanies can mismatch. Gesture-speech 'mismatches' are found when learners are on the verge of making progress on a task - when they are ready to learn. Moreover, mismatches provide insight into the mental processes that characterize learners when in...

A new technique for description and recognition of human gestures is presented. First, a method is proposed to represent gestures as an ordered sequence of simple basic motions. It is based on the rate of change of gesture motion direction (referred to as \curvature") that is estimated using optical ow from monocular motion images. Then, proceedings from the method, a real-time gesture recognit...

The use of hand gesture provides an attractive alternative to cumbersome interface devices for human-computer interactio n(HCI). Many methods for hand gesture recognition using visual analysis have been proposed such as syntactical analysis, neural network(NN), Hidden Markov Model(HMM) and so on. In our research, a HMM is proposed for alphabetical hand gesture recognition. In the preprocessing ...