Using Hand Gesture and Speech in a Multimodal Augmented Reality Environment
نویسندگان
چکیده
In this work we describe a 3D authoring tool which takes advantage of multimodal interfaces such as gestures and speech. This tool allows real-time Augmented Reality aimed to aid the tasks of interior architects and designers. This approach intends to be an alternative to traditional techniques. The main benefit of using a multi-modal based augmented reality system is the provision of a more transparent, flexible, efficient and expressive means of humancomputer interaction.
منابع مشابه
An Evaluation of an Augmented Reality Multimodal Interface Using Speech and Paddle Gestures
This paper discusses an evaluation of an augmented reality (AR) multimodal interface that uses combined speech and paddle gestures for interaction with virtual objects in the real world. We briefly describe our AR multimodal interface architecture and multimodal fusion strategies that are based on the combination of time-based and domain semantics. Then, we present the results from a user study...
متن کاملTouching the Visualized Invisible: Wearable AR with a Multimodal Interface
Wearable computers and their novel applications demand more context-specific user interfaces than traditional desktop paradigms can offer. We describe a multimodal interface to a wearable computing system and explain how it enhances a mobile user’s situational awareness and provides new functionality. Our mobile augmented reality system visualizes otherwise “invisible” information encountered i...
متن کاملSenseshapes: using statistical geometry for object selection in a multimodal augmented reality system - Mixed and Augmented Reality, 2003. Proceedings. The Second IEEE and ACM International Symposium on
We introduce a set of statistical geometric tools designed to identify the objects being manipulated through speech and gesture in a multimodal augmented reality system. SenseShapes are volumetric regions of interest that can be attached to parts of the user’s body to provide valuable information about the user’s interaction with objects. To assist in object selection, we generate a rich set of...
متن کاملAugmented World: Real Time Gesture Based Image Processing Tool with Intel RealSenseTM Technology
Intel RealSenseTM is an exciting new technology that offers innovative multimodal human computer interaction with hand tracking, face tracking, emotion detection, speech synthesis and voice recognition. The technology supports real time background separation by combining the depth and RGB streams of RealSenseTM camera. Several past works have provided robust techniques for background separation...
متن کاملCollaborative Visualization of an Archaeological Excavation
We are developing a collaborative system for offsite visualization of an archaeological dig site through both virtual and augmented reality. Multiple users, wearing tracked, head-worn, see-through displays, can interact with the environment using tracked, instrumented gloves, a multi-user, multi-touch, projected table surface, large wall displays and tracked hand-held displays. We take advantag...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007