This paper presents a new type of gesture for identifying spatiotemporal patterns: the analog gesture. Analog gestures can be characterized by some features (speed, acceleration, direction, and angle) which describe the dynamic morphology of the gesture. At first, we detail interactive tasks that should benefit for the use of analog gestures. Then we give a state of the art concerning gesture r...

With ”Gesturefication” we designate the creation of a mapping between gestural control and sound synthesis parameters based on the recording and analysis of a sound and related gestures. These gestures may have actually produced the sound or simply describe the sound from a particular point of view such as instrument performance, music conducting or active and embodied music listening. Our work...

Human communication is inherently multimodal. In this study we focus on three channels of spoken discourse: the verbal component, prosody, and gesticulation. We address the question of units that can be identified within these components and in spoken multimodal discourse as a whole. The basic unit of the verbal channel is the clause, reporting an event or a state. A set of prosodic criteria he...

Mechanical design tools would be considerably more useful if we could interact with them in the way that human designers communicate design ideas to one another, i.e., using crude sketches and informal speech. Those crude sketches frequently contain pen strokes of two different sorts, one type portraying device structure, the other denoting gestures, such as arrows used to indicate motion. We r...

Gestures are a natural and effective altenative to command mobile robots. This paper describes an online visual recognition system to recognize a set of 5 dynamic gestures executed with the user’s right hand and oriented to command mobile robots. The system employs a radial scan segmentation algorithm combined with a statistical-based skin detection method to find the candidate face of the user...

Gesture Recognition using Computer Vision opens up a whole new frontier in Human-Computer Interaction. Hand gestures are natural, intuitive, and require almost no learning, or remembering whatsoever. The proposed work involves developing a system to translate gestures (predetermined) performed by the user to control the active application on a computer. Viola-Jones Cascade Object Detector with ...

In order to ensure smooth turn-taking between conversational participants, interlocutors must have ways of providing information to one another about whether they have finished speaking or intend to continue. The current work investigates Swedish speakers’ use of hand gestures in conjunction with turn change or turn hold in unrestricted, spontaneous speech. As has been reported by other researc...

We present a system capable of visually detecting pointing gestures and estimating the 3D pointing direction in real-time. We use Hidden Markov Models (HMMs) trained on different phases of sample pointing gestures to detect the occurrence of a gesture. For estimating the pointing direction, we compare two approaches: 1) The line of sight between head and hand and 2) the forearm orientation. Inp...

Surface gesture interaction styles used on mobile touchscreen devices often depend on the platform and application. Some applications show a visual trace of gesture input being made by the user, whereas others do not. Little work has been done examining the usability of visual feedback for surface gestures, especially for children. In this paper, we extend our previous work on an empirical stud...