We present a trainable, visually-grounded, spoken language understanding system. The system acquires a grammar and vocabulary from a “show-and-tell” procedure in which visual scenes are paired with verbal descriptions. The system is embodied in a table-top mounted active vision platform. During training, a set of objects is placed in front of the vision system. Using a laser pointer, the system...

For automatic lipreading, there are many competing methods for feature extraction. Often, because of the complexity of the task these methods are tested on only quite restricted datasets, such as the letters of the alphabet or digits, and from only a few speakers. In this paper we compare some of the leading methods for lip feature extraction and compare them on the GRID dataset which uses a co...

the extensive research done on the interrelationship between different social factors such as social class, gender and age and different linguistic variables has shown that these factors have important effects on the way language is used. among these factors a special importance can be placed on age due to the role it plays in revealing different patterns of language use, such as the age-gradin...

The purpose of the present study was to identify any significant relationship between critical thinking ability, L2 vocabulary knowledge, and L2 vocabulary learning strategies of Iranian EFL learners. To this aim, the productive vocabulary levels test was administered to measure the learner’s L2 vocabulary knowledge and observe homogeneity in terms of vocabulary knowledge. At the second stage, ...

Orthogonal information present in the video signal associated with the audio helps in improving the accuracy of a speech recognition system. Audio-visual speech recognition involves extraction of both the audio as well as visual features from the input signal. Extraction of visual parameters is done by the recognition of speech dependent features from the video sequence. This paper uses geometr...