Prosody and gesture have, with few exceptions, not appealed to computational linguists, and there is even less awareness of the parallels between them, though in modelling sign languages of the hearing-impaired, the linguistic metaphor of gesture patterns as ‘phonology’ has been very fruitful. On the other hand, many disciplines from anthropological linguistics to robotics are currently occupie...

In this paper an algorithm to recognize single stroke gestures using a Time-of-Flight camera is presented. To achieve this goal, freehand gesture input is provided by articulating a single stroke in three-dimensional space using a stretched nger. The position of the ngertip is tracked and gesture input can be deactivated by forming a st. In this way, the start and end of a gesture is recognized...

Children who observe gesture while learning mathematics perform better than children who do not, when tested immediately after training. How does observing gesture influence learning over time? Children (n = 184, ages = 7-10) were instructed with a videotaped lesson on mathematical equivalence and tested immediately after training and 24 hr later. The lesson either included speech and gesture o...

In this paper, we introduce a hand gesture recognition system to recognize continuous gesture before stationary background. The system consists of four modules: a real time hand tracking and extraction, feature extraction, hidden Markov model (HMM) training, and gesture recognition. First, we apply a real-time hand tracking and extraction algorithm to trace the moving hand and extract the hand ...

We propose a novel gesture spotting approach that offers a comprehensible representation of automatically inferred spatiotemporal constraints. These constraints can be defined between a number of characteristic control points which are automatically inferred from a single gesture sample. In contrast to existing solutions which are limited in time, our gesture spotting approach offers automated ...

Gesture Recognition means identification and recognition of gestures originated from any type of bodily motion commonly originated from face or hand. It is a technology with the goal of interpreting human gestures via mathematical algorithms; also referred as perceptual user interface (PUI). Gesture recognition enables humans to interact with the machine (HMI) naturally without any physical con...

In this paper I explore the role of gesture in the development of signed languages. Using data from American Sign Language, Catalan Sign Language, French Sign Language, and Italian Sign Language, as well as historical sources describing gesture in the Mediterranean region, I demonstrate that gesture enters the linguistic system via two distinct routes. In one, gesture serves as a source of lexi...

Gesture is one of the most natural and expressive ways of communications between human and computer in a real system. We naturally use various gestures to express our own intentions in everyday life. Hand gesture is one of the important methods of non-verbal communication for human beings. Hand gesture recognition based man-machine interface is being developed vigorously in recent years. This p...

We compared gesturing by aphasic speakers to that of healthy controls, to see if gesture degrades with speech, or can be compensatory. We found that gestures by aphasics were less informative than those of controls, and that gestures by people with severe aphasia were less informative than those by people with mild aphasia. We also found that aphasics tended to use fewer representation techniqu...

Gesture-based interfaces, in which the user specifies commands by simple freehand drawings, offer an alternative to traditional keyboard, menu, and direct manipulation interfaces. The ability to specify objects, an operation, and additional parameters with a single intuitive gesture makes gesture-based systems appealing to both novice and experienced users. Unfortunately, the difficulty in buil...