Using Hand Gesture and Speech in a Multimodal Augmented Reality Environment

نویسندگان

  • José Miguel Salles Dias
  • Rafael Bastos
  • João Fernandes
  • João Tavares
  • Pedro Santos
چکیده

In this work we describe a 3D authoring tool which takes advantage of multimodal interfaces such as gestures and speech. This tool allows real-time Augmented Reality aimed to aid the tasks of interior architects and designers. This approach intends to be an alternative to traditional techniques. The main benefit of using a multi-modal based augmented reality system is the provision of a more transparent, flexible, efficient and expressive means of humancomputer interaction.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

An Evaluation of an Augmented Reality Multimodal Interface Using Speech and Paddle Gestures

This paper discusses an evaluation of an augmented reality (AR) multimodal interface that uses combined speech and paddle gestures for interaction with virtual objects in the real world. We briefly describe our AR multimodal interface architecture and multimodal fusion strategies that are based on the combination of time-based and domain semantics. Then, we present the results from a user study...

متن کامل

Touching the Visualized Invisible: Wearable AR with a Multimodal Interface

Wearable computers and their novel applications demand more context-specific user interfaces than traditional desktop paradigms can offer. We describe a multimodal interface to a wearable computing system and explain how it enhances a mobile user’s situational awareness and provides new functionality. Our mobile augmented reality system visualizes otherwise “invisible” information encountered i...

متن کامل

Senseshapes: using statistical geometry for object selection in a multimodal augmented reality system - Mixed and Augmented Reality, 2003. Proceedings. The Second IEEE and ACM International Symposium on

We introduce a set of statistical geometric tools designed to identify the objects being manipulated through speech and gesture in a multimodal augmented reality system. SenseShapes are volumetric regions of interest that can be attached to parts of the user’s body to provide valuable information about the user’s interaction with objects. To assist in object selection, we generate a rich set of...

متن کامل

Augmented World: Real Time Gesture Based Image Processing Tool with Intel RealSenseTM Technology

Intel RealSenseTM is an exciting new technology that offers innovative multimodal human computer interaction with hand tracking, face tracking, emotion detection, speech synthesis and voice recognition. The technology supports real time background separation by combining the depth and RGB streams of RealSenseTM camera. Several past works have provided robust techniques for background separation...

متن کامل

Collaborative Visualization of an Archaeological Excavation

We are developing a collaborative system for offsite visualization of an archaeological dig site through both virtual and augmented reality. Multiple users, wearing tracked, head-worn, see-through displays, can interact with the environment using tracked, instrumented gloves, a multi-user, multi-touch, projected table surface, large wall displays and tracked hand-held displays. We take advantag...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007