Multimodal Dialogue Systems: A Case Study for Interactive TV
نویسندگان
چکیده
Many studies have already shown the advantages of building multimodal systems. In this case study we have shown the advantages of combining natural language and a graphical interface in the interactive TV domain. In this paper we describe a multimodal dialogue TV program guide system that is a research prototype built for the case study by adding speech interaction to an already existing TV program guide. Study results indicate positive attitudes towards providing two input modes ? spoken natural language input and direct manipulation by means of remote control.
منابع مشابه
Very-High-Fidelity Prototyping for Both Presentation and Dialogue Parts of Multimodal Interactive Systems
This paper presents a tool suite (made up of two previously unrelated approaches) for the engineering of multimodal Post-WIMP Interactive Systems. The first element of this integration is ICOM (a data-flow model dedicated to low-level input modelling) and its environment ICON which allows for editing and simulating ICOM models. The other element is ICOs (a formal description technique mainly de...
متن کاملAn approach integrating two complementary model-based environments for the construction of multimodal interactive applications
This paper presents a tool suite for the engineering of multimodal Post-WIMP Interactive Systems. The work presented here extends previous work done on design, prototyping, specification and verification of interactive systems and integrates two previously unrelated approaches. The first element of this integration is ICOM (a dataflow model dedicated to low-level input modelling) and its enviro...
متن کاملCoordination of referring expressions in multimodal human-computer dialogue
This study examines coordination of referring expressions in multimodal human-computer dialogue, i.e. to what extent users’ choices of referring expressions are affected by the referring expressions that the system is designed to use. An experiment was conducted, using a semi-automatic multimodal dialogue system for apartment seeking. The user and the system could refer to areas and apartments ...
متن کاملEmbodied Presentation Teams: A plan-based approach for affective sports commentary in real-time
Virtual agents are essential representatives of multimodal user interfaces. This thesis presents the IVAN system (Intelligent Interactive Virtual Agent Narrators) that generates affective commentary on a tennis game that is given as an annotated video in real-time. The system employs two distinguishable virtual agents that have different roles (TV commentator, expert), personality profiles, and...
متن کاملMultimodal Dialog Description Language for Rapid System Development
In this paper, we explain a rapid development method of multimodal dialogue sys-tem using MIML (Multimodal Interaction Markup Language), which defines dialogue patterns between human and various types of interactive agents. The feature of this language is three-layered description of agent-based interactive systems which separates task level description, interaction description and device depen...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2002