In this paper some applications of a theory for representation and inference in multimodal scenarios is presented. The theory is focused on the relation between natural language and graphical expressions. A basic assumption is that graphical expressions belong to a language with well-defined syntax and semantics: a graphical language. A second assumption is that the relation between expressions...

Parallel corpus are bilingual or multilingual composed of the original text and its parallel counterparts in target language. Bilingual corpushas closest relationship with translation, providing rich translated texts convenient translation means. The new media era has put forward requirements for tourism translation. As number foreign tourists coming to Liaoning increases year by year, problems...

Ateji (当て字) pertains to one of the unique uses language in manga that is constructed with two types Japanese scripts. Its one-of-a-kind structure presents challenges translation, but feasible solutions have hardly been explored. Drawing on ateji categories, social semiotic multimodal approach and translation procedures, this study performs qualitative content analysis identify practical ways re...

Recent work on multimodal machine translation has attempted to address the problem of producing target language image descriptions based on both the source language description and the corresponding image. However, existingwork has not been conclusive on the contribution of visual information. This paper presents an in-depth study of the problem by examining the differences and complementaritie...

Researchers have long been interested in the synergy between portability and computing power but had been limited by unwieldy, uncommonly used devices. The latest generation of mobile phones, i.e. ‘smartphones’, are equipped with hardware powerful enough to develop novel, interesting applications with allow users to directly interact with the world around them. This paper describes a multimodal...