Mathematics has been the basis of computation since the beginning of computer science and the algebraic expression and functional notation has been the basic model of computation. This basis in effect limits programming to a relatively few highly trained individuals. However, today computers are ubiquitous and there is a great need for allowing less trained people to program. Some of the proble...

Currently, verbally dictating commands and programs to a computer is not practical because in our experiments, 10% to 15% of the words and 30% to 80% of the commands and statements were misrecognized by the Automatic Speech Recognition (ASR) systems. Interpreting Noisy Prose (INP) is a post ASR algorithm designed to execute on and utilize the extensive computing power of heterogeneous multi-cor...

Pointing Deictic gestures, or points, have the obvious function of indicating objects around the narrator, but they also play a part in narrations where there is nothing objectively present to point at. Although the gesture space may look empty, to the speaker it is filled with discourse entities. Deictic gestures establish in space the participants of a narrative and the participant events. An...