This paper summarizes an experiment in the formal specification of the visual language for the Geometric Machine model [3], denoted by GMVL. The specification follows the approach proposed in the GENGED project, of the T. U. Berlin [1]. In the GMLV, supported by a visual alphabet and a visual grammar, a process constructor is represented by a graph transformation related to a rule application i...

This study drew upon Kress and Van Leeuwen’s (2006, [1996]) visual grammar and Van Leeuwen’s (2008) social semiotic model to interrogate ways through which social actors of different races are visually and textually represented in four award-winning English-learning software packages.  The analysis was based on narrative actional/reactional processes at the ideational level; mood, perspective, ...

Spatial grammars are rule based, generative systems for the specification of formal languages. Set and shape grammar formulations of spatial grammars enable the definition of spatial design languages and the creation of alternative designs. Since the introduction of the underlying formalism, they have been successfully applied to different domains including visual arts, architecture, and engine...

Organization-based multi-agent systems (MAS) can be represented by means of 3D virtual worlds facilitating then the interaction among participants, i.e humans and agents. In this paper we propose a system that can automatically generate a 3D virtual world from formal specifications of both a MAS and a design visual style (i.e a shape grammar). We propose an extension of shape grammars in combin...

In the last decade there has been an increasing interest in the use of tools for the creation of geographic maps. However, these tools include functionalities that allow users to insert information without verifying their consistency with the constraints defined by the designer. In this paper we propose an approach based on visual language parsing for guaranteeing the integrity of data produced...

We present a visual approach to layout static components of user interfaces as hand-drawn compositions of simple geometric shapes, based on sketch recognition. We have defined a visual grammar using drawing data from target users, where we tried to figure out how people sketch interfaces and what combinations of shapes are more commonly used to define widgets. From these we built our grammar an...

Patients with Parkinson's disease (PD) have been shown to be impaired on some nondeclarative memory tasks that require cognitive skill learning (perceptual-motor sequence learning, probabilistic classification). To determine what other skill-based tasks are impaired, 13 patients with PD were tested on artificial grammar learning, artificial grammar learning with transfer to novel lettersets, an...

We describe a system for content-based retrieval and classification of multispectral images. Our system models images on pixel, region and scene levels. To reduce the gap between low-level features and highlevel user semantics, and to support complex query scenarios that consist of many regions with different feature characteristics, we propose a probabilistic visual grammar that includes autom...

The widespread use of visual languages has motivated the need for grammar-based tools to support designers in the definition and implementation of graphical environments. The effective use of such systems requires efficient parsing techniques. The VLCC system makes use of a suitable LR-like methodology that allows us to efficiently parse visual sentences [1]. However there exist particular gram...

We present a cognitively plausible system capable of acquiring knowledge in language and vision from pairs of short video clips and linguistic descriptions. The aim of this work is to teach a robot manipulator how to execute natural language commands by demonstration. This is achieved by first learning a set of visual ‘concepts’ that abstract the visual feature spaces into concepts that have hu...