Identifying, Applying and Evaluating Gestural Interaction in Ubiquitous and Pervasive Computing

We describe our ongoing research into gesture as an interaction technique for ubiquitous and pervasive computing. The goal of our research is to, 1. identify, through studies on user generated gestures, a gesture set for ubiquitous and pervasive computing which is both useful and useable across a range of devices, services and contexts 2. apply this gesture set to a range of gesture recognition systems and collect data on both user performance and preference as well as system performance 3. explore the trade off between the requirement for gestures which users regard as a good fit to the tasks they are performing, and gestures which are recognizable by the system 4. explore how both the user and the system adapt to each other over time We report our previous work where a series of linked empirical studies and system development enabled us to gain an insight into the identification, application and evaluation of gesture [2]. Furthermore, we report our ongoing and future research which aims to propose two complementary frameworks. The first aims to identify gestures based on end user consensus and preference. The second is to enable data regarding user and system performance and preference to be used to evaluate the identified gestures taking into account, 1. the trade off between the need for high system performance and high user performance and preference and 2. the co-adaptation of the user and the system over time.