Gesture recognition is needed for a variety of applications such as human-computer interfaces, communication aids for the deaf, etc. In this paper, we present a SOMART system for the recognition of hand gestures. The sequence of a hand gesture is first projected into a 2-dimensional trajectory on a self-organizing feature map (SOM). Then the problem of recognizing hand gestures is transformed t...

Cognitive goals – i.e. the intention to utter a sentence and to produce co-speech facial and hand-arm gestures – as well as the sensorimotor realization of the intended speech, co-speech facial, and co-speech hand-arm actions are modulated by the emotional state of the speaker. In this review paper it will be illustrated how cognitive goals and sensorimotor speech, co-speech facial, and co-spee...

this paper presents a study examining how persian speakers use metaphoric gestures to represent different adverbs of time, and what these gestures reveal about the concept of time in their minds. a questionnaire containing 10 ambiguous questions, which made the participant use different adverbs of time, was given to 22 participants. they were filmed while trying to answer the questions. the cor...

In user interfaces of modern systems, users get the impression of directly interacting with application objects. In 3D based user interfaces, novel input devices, like hand and force input devices, are being introduced. They aim at providing natural ways of interaction. The use of a hand input device allows the recognition of static poses and dynamic gestures performed by a user’s hand. This pa...

This paper proposes a system to recognize the alphabets and numbers in real time from color image sequences by the motion trajectory of a single hand using Hidden Markov Models (HMM). Our system is based on three main stages; automatic segmentation and preprocessing of the hand regions, feature extraction and classification. In automatic segmentation and preprocessing stage, YCbCr color space a...

The multimodal human-computer interface (HCI) called LipMouse is presented, allowing a user to work on a computer using movements and gestures made with his/her mouth only. Algorithms for lip movement tracking and lip gesture recognition are presented in details. User face images are captured with a standard webcam. Face detection is based on a cascade of boosted classifiers using Haar-like fea...

This paper describes our design policy and prototype data collection of RWC (Real World Computing Program) multimodal database. The database is intended for research and development on the integration of spoken language and visual information for human computer interactions. The interactions are supposed to use image recognition, image synthesis, speech recognition, and speech synthesis. Visual...

Gestures are the very expressive and meaningful body motions. Gesture recognition provides meaningful expressions of motion by a human involving the hands, arms, face, head, and body. Human motion capture is used both when the subject is viewed as a single object and articulated motion with a number of joints. For example, Speech and handwriting, here gestures vary between individuals, and even...