People gesture a great deal when speaking, and research has shown that listeners can interpret the information contained in gesture. The current research examines whether learners can also use co-speech gesture to inform language learning. Specifically, we examine whether listeners can use information contained in an iconic gesture to assign meaning to a novel verb form. Two experiments demonst...

We explore two types of spatial alignment, overlay and gesture, during an engineering lesson on bridge building. Spatial alignment via juxtaposition (Gentner et al., under review) or overlay (Applebaum et al., in prep) has been found to promote understanding triangular bracing in stable structures. Gestures tracing a triangle may also support learning this concept. We used a 2(Gesture, No Gestu...

PURPOSE Previous work on the temporal coordination between gesture and speech found that the prominence in gesture coordinates with speech prominence. In this study, the authors investigated the anchoring regions in speech and pointing gesture that align with each other. The authors hypothesized that (a) in contrastive focus conditions, the gesture apex is anchored in the intonation peak and (b...

This paper proposes a novel approach to multi-modal gesture recognition by using skeletal joints and motion trail model. The approach includes two modules, i.e. spotting and recognition. In the spotting module, a continuous gesture sequence is segmented into individual gesture intervals based on hand joint positions within a sliding window. In the recognition module, three models are combined t...

This article describes an architecture for translating speech into Spanish Sign Language (SSL). The architecture proposed is made up of four modules: speech recognizer, semantic analysis, gesture sequence generation and gesture playing. For the speech recognizer and the semantic analysis modules, we use software developed by IBM and CSLR (Center for Spoken Language Research at University of Col...

In this paper, we describe a gesture expressivity analysis of a character in a conversational interaction. To determine gesture properties that attract and maintain perceptual attention, we study if there exists some effects in the field of gesture expressivity modulations. We study this role at a low level (gesture phase) and at a higher level (discourse structure) based on a corpus annotation...

During past few years, human hand gesture for interaction with computing devices has continues to be active area of research. In this paper survey of hand gesture recognition is provided. Hand Gesture Recognition is contained three stages: Pre-processing, Feature Extraction or matching and Classification or recognition. Each stage contains different methods and techniques. In this paper define ...

Wearable computing and Augmented Reality applications call for less obtrusive and more intuitive human computer interfaces than keyboards and mice. One way to realize such interfaces is using gestures, e.g., for pointing in order to replace the mouse. The less obtrusive way of gesture recognition is to use computer vision based methods. In this paper we present a computer vision-based gesture i...

The sensorimotor experiences we gain when performing an action have been found to influence how our own motor systems are activated when we observe others performing that same action. Here we asked whether this phenomenon applies to the observation of gesture. Would the sensorimotor experiences we gain when performing an action on an object influence activation in our own motor systems when we ...

During everyday communication co-speech gestures represent a ubiquitous tool to underpin the verbal content of a message. In addition to gestures, other non-verbal information, such as the direction in which a speaker’s body is oriented, is particularly important during face-to-face interaction. However, the influence of bodily orientation (frontal vs. lateral) and gestures on the evaluation of...