When creating realistic talking head animations, accurate modeling of speech articulators is important for speech perceptibility. Previous lip modeling methods such as simple numerical lip modeling focus on creating a general lip model without incorporating lip speaker variations. Here we present a method for creating accurate speaker-specific lip representations that retain the individual char...

Purpose Treatment for head and neck cancer can impair speech and swallowing, and can disfigure the face. Reconstructive surgery can restore some facial function and ameliorate disfigurement, thereby helping patients to psychosocially adjust. However, current surgical reconstruction techniques may not fully restore a patient's pre-cancerous appearance. Therefore, it is important to understand th...

In this paper, a novel Patch Geodesic Derivative Pattern (PGDP) describing the texture map of a face through its shape data is proposed. Geodesic adjusted textures are encoded into derivative patterns for similarity measurement between two 3D images with different pose and expression variations. An extensive experimental investigation is conducted using the publicly available Bosphorus and BU-3...

Conventional stereo algorithms often fail in accurately reconstructing a 3D object because the image data do not provide enough information about the geometry of the object. We propose a way to incorporate a priori information in a reconstruction process from a sequence of calibrated face images. A 3D mesh modeling the face is iteratively deformed in order to minimize an energy function. Di ere...

Conventional stereo algorithms often fail in accurately reconstructing a 3D object because the image data do not provide enough information about the geometry of the object. We propose a way to incorporate a priori information in a reconstruction process from a sequence of calibrated face images. A 3D mesh modeling the face is iteratively deformed in order to minimize an energy function. Diiere...

This paper deals with the development of novel sensory systems and interfaces to enhance the safety of a driver who may be using a cell phone. It describes a system for real time affect analysis and Tele-viewing in order to bring the context of the driver to remote users. The system is divided into two modules. The affect recognition module recognizes six emotional states of the driver. The fac...

When modeling in 3D CAD, architects often search for already existing 3D content to complete their own design, e.g. environmental models, furniture models or detailed window profiles. 3D models are normally indexed and accessed based on textual metadata. As this metadata is expensive to obtain, PROBADO3D aims to develop workflows and tools for semi-automatic indexing of 3D models. Another goal ...

We present a method for 3D face acquisition using a set or sequence of 2D binary silhouettes. Since silhouette images depend only on the shape and pose of an object, they are immune to lighting and/or texture variations (unlike feature or texturebased shape-from-correspondence). Our prior 3D face model is a linear combination of ”eigenheads” obtained by applying PCA to a training set of laser-s...