Adaptive graphical user interfaces have the potential to improve the user’s experience by personalizing the interface to better suit his or her needs. However, evaluations have yielded conflicting results: some studies show that adaptive menus and toolbars are faster or preferred in comparison to static counterparts [6,8], while others show the opposite [3,10,11]. We propose an evaluation appro...

Existing CASE tool diagram editors have large, complex, and sophisticated graphical user interfaces. Because of their size, these interfaces are difficult to learn and hard to use. A minimal interface for a diagram editor provides only the essential behaviour required by the user in the simplest possible manner. Minimal interfaces are smaller than traditional interfaces, and should be easier an...

Abstract This report presents an analysis of graphical procedural representations from the point of the view of the work on DRAFTER, a tool that supports the generation of English and French instructions for graphical user interfaces. It outlines the differences between procedural representations and rhetorical representations in the context of user interfaces, and then suggests the use of Davi...

We present the results of an investigation on software support for the SMUIML multimodal user interaction description language (UIDL). In particular, we introduce a graphical UIDL editor for the creation of SMUIML scripts. The data management as well as the dialogue modelling in our graphical editor is based on the SMUIML language. Due to the event-centered nature of SMUIML, the multimodal dial...

We present Sikuli, a visual approach to search and automation of graphical user interfaces using screenshots. Sikuli allows users to take a screenshot of a GUI element (such as a toolbar button, icon, or dialog box) and query a help system using the screenshot instead of name. Sikuli also provides a visual scripting API for automating GUI interactions, using screenshot patterns to direct mouse ...

Each command or transaction in a modern graphical user interface exists as a nearly independent utterance, unconnected to previous and future ones from the same user. This is unlike real human communication, where each utterance draws on previous ones for its meaning. While some natural language human-computer interfaces attempt to include such characteristics of human dialogue, they have been ...