Language is given meaning through its correspondence with a world representation. This correspondence can be at multiple levels of granularity or resolutions. In this paper, we introduce an approach to multi-resolution language grounding in the extremely challenging domain of professional soccer commentaries. We define and optimize a factored objective function that allows us to leverage discou...

This article discusses the current progress and solutions to the symbol grounding problem, indentify specifically which aspects of the problem have been already addressed, and which other issues and scientific challenges still require investigation. In particular, the paper suggests that of the various aspects of the symbol grounding problems, the one that still require significant research is ...

Cognitive Scientists have long grappled with the question how concepts are grounded in experiences. Recent years have witnessed a surge of interest in the grounding of conceptual knowledge in perceptual processes and actions. Important questions that have been part of the debate range from the necessity of grounding (from a theoretical perspective) to possible mechanisms (from an empirical pers...

How can we build robots that engage in fluid spoken conversations with people, moving beyond canned responses to words and towards actually understanding? As a step towards addressing this question, we introduce a robotic architecture that provides a basis for grounding word meanings. The architecture provides perceptual, procedural, and affordance representations for grounding words. A percept...

When humans and artificial agents (e.g. robots) have mismatched perceptions of the shared environment, referential communication between them becomes difficult. To mediate perceptual differences, this paper presents a new approach using probabilistic labeling for referential grounding. This approach aims to integrate different types of evidence from the collaborative referential discourse into ...

This paper reports an exploratory study of the grounding styles of older dyads, namely, the characteristic ways in which they mutually agree to have shared a piece of information in dialogue. On the basis of Traum’s classification of grounding acts, we conducted an exploratory comparison of dialogue data on older and younger dyads, and found that a fairly clear contrast holds mainly in the type...