An audio-visual intelligibility score is generally used as an evaluation measure in visual speech synthesis. Especially an intelligibility score of talking heads represents accuracy of facial models[1][2]. The facial models has two stages such as construction of real faces and realization of dynamical human-like motions. We focus on lip movement synthesis from input acoustic speech to realize d...

In this paper, we present a solution to the problem of tracking 3D information about the shape of lips from 2D picture of a speaker. We focus on lip-tracking of audio-visual speech recordings from the Czech in-vehicle audio-visual speech corpus (CIVAVC). The corpus consists of 4 h 40 min records of audiovisual speech of driver recorded in a car during driving in an usual traffic. In real condit...

An important part of the beneficial effects of calorie restriction (CR) on healthspan and lifespan is mediated through regulation of protein synthesis that is under control of the mechanistic target of rapamycin complex 1 (mTORC1). As one of its activities, mTORC1 stimulates translation into the metabolic transcription factor CCAAT/Enhancer Binding Protein β (C/EBPβ) isoform Liver-specific Inhi...

Audio-visual Speech Recognition has been an active area of research lately. A bit, and yet unsolved, part of this problem is the visual only recognition, or lip reading. Considering an image sequence of a person pronouncing a word, a full image analysis solution would have to segment the mouth area, extract relevant features, and use them to be able to classify the word from those visual featur...

This paper deals with mainly the profoundly deaf people who are beginning to learn the British Sign Language (BSL) as their first language for communication. These beginners could be children, teenagers or even adults who have hearing problems. There are already quite a few BSL learning websites and Lip Reading software available on the market. However, there is no such software that associates...

This thesis describes a method for augmenting an audio-only speech recognizer with visual lip-reading information, in order to improve the performance and robustness of the recognizer. The speech recognizer's variable length audio segments are resolved with the xed length video frames using segment constrained Hidden Markov Modeling. A Viterbi search over the per-segment Hidden Markov Model res...

Voice loss constitutes a crucial disorder which is highly associated with social isolation. The use of multimodal information sources, such as, audiovisual information, since it can lead to the development straightforward personalized word prediction models reproduce patient’s original voice. In this work we designed approach based on from patients before loss-of-voice develop system for automa...

When a child learns to read, the learning process can be enhanced by significant reading practice with individual support from a tutor. But in reality, the availability of teachers or clinicians is limited, so the additional use of a fully automated reading tutor would be beneficial for the child. This paper discusses our efforts to develop an automated reading tutor for Dutch. First, the dedic...