In this paper, we propose Viola, which can define CMG grammar graphically and execute a visual system on the same screen. By using Viola, the user can define various visual systems interactively. It became possible to define grammars using graphical expressions and construct visual systems dynamically, while checking the grammar at the execution time. We have actually implemented Viola in Java ...

Is it possible to reason by means of images? If it is, then with what kind of images can we organize thoughts? How can the rules governing the relations between images be established? Could these relations be as complex and productive as those defined within the grammar of the verbal language? The basic construction of any language, especially a developed one, is a structure of formal rules whi...

The theory of visual programming languages (VPLs) is very crucial for understanding the visual programming approach. It includes basically formal models for specifying VPLs and the corresponding parsing algorithms. This paper presents a grammatical formalism and an ecient parsing algorithm for visual languages. The proposed formalism, called modi®ed relation grammar (MRG), is a restricted form...

The implementation of visual programming languages (VPLs) and their supporting environments is time–consuming and tedious. To ease the implementation, researchers have developed some high level tools, which can greatly reduce the effort of developing VPLs. None of them, however, can be easily used to create a complete visual language in a seamless way like the lex/yacc tools for textual languag...

We present a new graph grammar based approach for defining the syntax of visual languages and for generating visual language parsers. Its main advantage  in comparison to other visual language parsing approaches  is its ability to handle context-sensitive productions which may replace more than one non-terminal at the same time and which may contain very complex context requirements. Its impl...

We previously developed the spatial parser generator Eviss, which automatically generates a spatial parser by defining the grammar of the visual language. In Eviss, we introduced “action” into CMGs in order to express the behavior of visual programming systems. However, in Eviss, the input of the grammar is performed using the text. If we can use a figure for inputting the grammar and edit it d...

This contribution presents a conceptual model of GENGED, an editor supporting the visual definition of visual languages (VLs). As usual a VL consists of an alphabet and a grammar. Given a grammar of a specific VL GENGED generates a syntax-directed graphical editor allowing the manipulation of visual sentences over this language. The conceptual framework of GENGED is based on algebraic graph tra...

We describe a system that allows non-programmers to specify the grammar for a novel graphic score notation of their own design, defining performance notations suitable for drawing in live situations on a surface such as a whiteboard. The score can be interpreted via the camera of a smartphone, interactively scanned over the whiteboard to control the parameters of synthesisers implemented in Ove...

Graph grammars and graph grammar parsers are to visual languages what string grammars and parsers are to textual languages. A graph grammar specifies a set of valid graphs and can thus be used to formalise the syntax of a visual language. A graph grammar parser is a tool for recognising valid programs in such a formally defined visual language. A parser for context-sensitive graph grammars, whi...

This study represents an interdisciplinary attempt to trace the origins of metaphorical expressions as they are found in English grammatical terminology. The perspective chosen combines cognitive and art-historical approaches to the meaning of abstract concepts: cognitive semantics and iconography. It takes into account the historical dimension of the media which have served, over the course of...