The scope of this paper is the interpretation of a user’s intention via a video camera and a speech recognizer. In comparison to previous work which only takes into account gesture recognition, we demonstrate that by including speech, system comprehension increases. For the gesture recognition, the user must wear a colored glove, then we extract the velocity of the center of gravity of the hand...

Gesture recognition means the identification of different expressions of human body parts to express the idea, thoughts and emotion. It is a multi-disciplinary research area. The application areas of gesture recognition have been spreading very rapidly in our real-life activities including dance gesture recognition. Dance gesture recognition means the recognition of meaningful expression from t...

This application helps the deaf and dumb person to communicate with the rest of the world using sign language. Suitable existing methods are integrated in this application. The key feature in this system is the real time gesture to text conversion. The processing steps include: gesture extraction, gesture matching and conversion to speech. Gesture extraction involves use of various image proces...

An affordance gesture motion interpolation is proposed, using an intuitive wireless 6DOF gesture input device, which includes Magnetic, Angular Rate, and Gravity (MARG) sensors, and a user interactive 3D gesture control interface, for creating motion by pose interpolation, from Dynamic Time Warping (DTW) gesture recognizer algorithm. In this paper we demonstrate that user can create and control...

Iconic gestures are hand movements that represent shapes, objects and functions of a referent. When gesture is restricted, imagery decreases and speech dysfluencies (which are most pronounced when communicating spatial information) increase. Since gesture restriction adversely affects both imagery and the communication of spatial information, many theorists have argued that visuospatial working...

Italian children are immersed in a gesture-rich culture. Given the large gesture repertoire of Italian adults, young Italian children might be expected to develop a larger inventory of gestures than American children. If so, do these gestures impact the course of language learning? We examined gesture and speech production in Italian and US children between the onset of first words and the onse...

PURPOSE In this study, the authors (a) investigated whether a group of people with severe aphasia could learn a vocabulary of pantomime gestures through therapy and (b) compared their learning of gestures with their learning of words. The authors also examined whether gesture therapy cued word production and whether naming therapy cued gestures. METHOD Fourteen people with severe aphasia rece...

Gesture recognition is a challenging task for extracting meaningful gesture from continuous hand motion. In this paper, we propose an automatic system that recognizes isolated gesture, in addition meaningful gesture from continuous hand motion for Arabic numbers from 0 to 9 in real-time based on Hidden Markov Models (HMM). In order to handle isolated gesture, HMM using Ergodic, Left-Right (LR) ...

Dynamic Time Warping (DTW) is commonly used in gesture recognition tasks in order to tackle the temporal length variability of gestures. In the DTW framework, a set of gesture patterns are compared one by one to a maybe infinite test sequence, and a query gesture category is recognized if a warping cost inferior to a given value is found within the test sequence. Nevertheless, either taking one...