A state-based technique for the summarization and recognition of gesture is presented. We de-ne a gesture to be a sequence of states in a measurement or connguration space. For a given gesture, these states are used to capture both the repeatability and variability evidenced in a training set of example trajectories. The states are positioned along a prototype of the gesture, and shaped such th...

How are co-speech iconic gestures used to convey visuo-spatial information? We investigate this question, which is still relatively unexplored [1], with an interdisciplinary methodology combining the empirical study of speech and gesture use, the elaboration of theoretical reconstructions and the formulation of generation models that enable the simulation of such communicative behaviour with vi...

The interactive demands of the upcoming ubiquitous computing era have set off researchers and practitioners toward prototyping new gesture-sensing devices and gadgets. At the same time, the practical needs of developing for such miniaturized prototypes with sometimes very low processing power and memory resources make practitioners in high demand of fast gesture recognizers employing little mem...

Gesture is a natural expression form for humans, but its recognition is a similarly hard problem as speech recognition. In this paper, I present a real-time hand gesture recognition system, which identifies relevant parts in the continous sensor data stream, and classifies them to the most probable gesture. Instead of the usual button-based segmentation, I have created an automatic segmentation...

Recently people do not only use mobile phone to call, but also use it to send a SMS. However, it is difficult to express own complicated emotion with text and emoticon of exited SMS service. We pay attention to express user’s emotion interesting and correct, we use character animation. This paper suggests emotion based gesture animation generation system that uses character's facial expression ...

Gesture recognition is needed for a variety of applications such as human-computer interfaces, communication aids for the deaf, etc. In this paper, we present a SOMART system for the recognition of hand gestures. The sequence of a hand gesture is first projected into a 2-dimensional trajectory on a self-organizing feature map (SOM). Then the problem of recognizing hand gestures is transformed t...

The gestures children produce predict the early stages of spoken language development. Here we ask whether gesture is a global predictor of language learning, or whether particular gestures predict particular language outcomes. We observed 52 children interacting with their caregivers at home, and found that gesture use at 18 months selectively predicted lexical versus syntactic skills at 42 mo...

This paper presents a new type of gesture for identifying spatiotemporal patterns: the analog gesture. Analog gestures can be characterized by some features (speed, acceleration, direction, and angle) which describe the dynamic morphology of the gesture. At first, we detail interactive tasks that should benefit for the use of analog gestures. Then we give a state of the art concerning gesture r...

Map is a powerful and convenient tool in helping us to navigate to different places, but the use of indirect devices often makes its usage cumbersome. This study intends to propose a new map navigation dialogue that uses hand gesture. A set of dialogue was developed from users’ perspective to provide users complete freedom for panning, zooming, rotate, tilt and find direction operations. A part...

Virtual Environment (VE) system offers a natural and intelligent user interface. Hand gesture recognition is more efficient and easier interaction in VE than human-computer interface (HCI) devices like keyboards and mouses. We propose a hand gesture recognition interface that generates commands to control objects directly in a game. Our novel hand gesture recognition system utilizes both Bag-of...