When teachers gesture during instruction, children retain and generalize what they are taught (Goldin-Meadow, 2014). But why does gesture have such a powerful effect on learning? Previous research shows that children learn most from a math lesson when teachers present one problem-solving strategy in speech while simultaneously presenting a different, but complementary, strategy in gesture (Sing...

Tomorrow's ubiquitous computing environments will go beyond the keyboard, mouse and monitor paradigm of interaction and will require the automatic interpretation of human motion using a variety of sensors including video cameras. I present several techniques for human motion recognition that are inspired by observations on human gesture, the class of communicative human movement. Typically, ges...

Vision-based hand gesture interactions are natural and intuitive when interacting with computers, since we naturally exploit gestures to communicate with other people. However, it is agreed that users suffer from discomfort and fatigue when using gesture-controlled interfaces, due to the lack of physical feedback. To solve the problem, we propose a novel complete solution of a hand gesture cont...

This paper presents a novel method for human gesture recognition based on quadratic curves. Firstly, face and hands in the images are extracted by skin color and their central points are kept tracked by a modified Greedy Exchange algorithm. Then in each trajectory, the central points are fitted into a quadratic curve and 6 invariants from this quadratic curve are computed. Following these compu...

Gesture is an integral feature of nonverbal communication that serves as an outward manifestation of several interacting fundamental processes including motor behavior, language, and sensory integration. Likewise, gesturing has been linked to semantic retrieval, learning, and communicative ability. Indeed, processing of gesture performance and perception involves cerebral networks of multimodal...

In this paper we present a novel framework to model a dynamic hand gesture by k-dimensional vector that incorporates both the hand shape as well as the trajectory information. We introduce the notion of ‘distance’ between dynamic gestures to help choose a proper set of gestures for the gesture vocabulary. We also utilise inter-gesture distances for gesture recognition. We show encouraging resul...

This paper presents a video based system for hand-gesture recognition. It is able to process the video data and to classify the gestures in real time. Even more, there exists a method for gesture tracking and fault tolerant recognition of gesture sequences. By choosing the colour video channel the system is almost independent of light innuence. For demonstration two practical applications of th...

Several theories of gesture production predict that speech production is affected when gestures are prohibited. The present study sought evidence for these predictions by asking participants to describe how to complete three motor tasks. Half of the participants were prohibited from gesturing during their descriptions. We found that participants who were free to gesture described a higher perce...

How does modality affect people's ability to create a communication system from scratch? The present study experimentally tests this question by having pairs of participants communicate a range of pre-specified items (emotions, actions, objects) over a series of trials to a partner using either non-linguistic vocalization, gesture or a combination of the two. Gesture-alone outperformed vocaliza...

Recently, developing interaction techniques that allow gesture recognition for home application and game control is one popular field in Human-ComputerInteraction (HCI) research. In this paper, we proposed a method for hand gesture recognition using artificial neural network algorithm commonly used in HCI. Previous studies have generally used distinguished distribution datasets. However, in the...