A Common Gesture and Speech Production Framework for Virtual and Physical Agents
نویسندگان
چکیده
We introduce a modular system to generate communicative expressive gestures accompanying speech for an agent. This system is designed as a common model for different embodiments so that its processes are independent from a specific agent. There are two main features of this system. Firstly gesture expressivity is taken into account when gesture animation are computed on the fly from abstract gesture templates. Secondly gestures are scheduled to ensure that their execution are tightly tied to speech. In this paper, we present the first implementation of this system being used to control co-verbal gestures of the Greta virtual agent and of the Nao physical robot.
منابع مشابه
Generating Multi-Modal Robot Behavior Based on a Virtual Agent Framework
One of the crucial steps in the attempt to build sociable, communicative humanoid robots is to endow them with expressive non-verbal behaviors along with speech. One such behavior is gesture, frequently used by human speakers to emphasize, supplement, or even complement what they express in speech. The generation of speech-accompanying robot gesture together with an evaluation of the effects of...
متن کاملCoexpressivity of speech and gesture: Lessons for models for aligned speech and gesture production
When people combine language and gesture to convey their intended information, both modalities are characterized by an intriguing degree of coherence and consistency. For developing an account how speech and gesture are aligned to each other, one question of major importance is how meaning is distributed across the two channels. In this paper, we start from recent empirical findings indicating ...
متن کاملA Multimodal Scheduler for Synchronized Humanoid Robot Gesture and Speech
In order to engage in natural and fluent human-robot interaction, humanoid robot companions must be able to produce speech-accompanying non-verbal behavior including hand and arm gestures. In human communication, gestures are considered an integral part of the human thinking process. Accordingly, they are found to be finely synchronized with the accompanying linguistic affiliate [1]. Many resea...
متن کاملHuman Computer Interaction Using Vision-Based Hand Gesture Recognition
With the rapid emergence of 3D applications and virtual environments in computer systems; the need for a new type of interaction device arises. This is because the traditional devices such as mouse, keyboard, and joystick become inefficient and cumbersome within these virtual environments. In other words, evolution of user interfaces shapes the change in the Human-Computer Interaction (HCI). In...
متن کاملA common functional neural network for overt production of speech and gesture.
The perception of co-speech gestures, i.e., hand movements that co-occur with speech, has been investigated by several studies. The results show that the perception of co-speech gestures engages a core set of frontal, temporal, and parietal areas. However, no study has yet investigated the neural processes underlying the production of co-speech gestures. Specifically, it remains an open questio...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2012