Seventeen Ss were videotaped as they provided narrative descriptions of 13 photographs. Judgments from 129 naive untrained Ss were used to isolate 60 speech-related gestures and their lexical affiliates (i.e., the accompanying word or phrase judged as related in meaning) from these 221 narratives. A computer-video interface measured each gesture, and a 3rd group of Ss rated word familiarity of ...

Little work has been done on understanding the articulation patterns of users’ touch and surface gestures, despite the importance of such knowledge to inform the design of gesture recognizers and gesture sets for different applications. We report a methodology to analyze user consistency in gesture production, both between-users and within-user, by employing articulation features such as stroke...

The use of computers as Digital Musical Instruments (DMI) rises many problems due to the separation between gesture and sound production. However, computational power allows now for complex real-time analysis and gesture anticipation and recognition. We present here an interactive performance system for a percussionist playing in the air, with no physical percussion. Since the gesture sensors a...

A genetic algorithm (GA) is an optimization algorithm that simulates the hereditary phenomenon of natural life. Although GA has been applied to image processing, it has not been studied to apply for matching hand gesture images. In this paper, a method to use GA for the matching process of hand gesture images expressing numbers is proposed. The processing algorithm including GA for hand gesture...

Gestures and speech interact. They are linked in language production and perception, with their interaction contributing to felicitous communication. The multifaceted nature of these interactions has attracted considerable attention from the speech and gesture community. This article provides an overview of our current understanding of manual and head gesture form and function, of the principle...

Computer applications have been spread ubiquitous due to its essential important that facilitate our daily life, gesture system is one of the most appealing applications that dependents mainly on exploiting the right features that can embody the entire gesture and give the correct meaning of that gesture. For constructing gesture recognition system a serial steps should be considered that are: ...

Why do speakers produce gestures? !is study tests the hypothesis that gesture facilitates the conceptual planning of speaking, and in particular, gesture promotes thinking about perceptually present information. !is view implies that, when gesture is prohibited, people should be less likely to speak about such information. We tested this prediction among children (N = 50) who solved and explain...

Sighted speakers of different languages vary systematically in how they package and order components of a motion event in speech. These differences influence how semantic elements are organized in gesture, but only when those gestures are produced with speech (co-speech gesture), not without speech (silent gesture). We ask whether the cross-linguistic similarity in silent gesture is driven by t...

Children understand gesture+speech combinations in which a deictic gesture adds new information to the accompanying speech by age 1;6 (Morford & Goldin-Meadow, 1992; 'push'+point at ball). This study explores how early children understand gesture+speech combinations in which an iconic gesture conveys additional information not found in the accompanying speech (e.g., 'read'+BOOK gesture). Our an...

This paper presents some possible relationships between gesture and sound that may be built with an interactive digital audio environment. In a traditional musical situation gesture usually produces sound. The relationship between gesture and sound is unique, it is a cause to effect link. In computer music, the possibility of uncoupling gesture from sound is due to the fact that computer can ca...