A 3D facial reconstruction and expression modeling system which creates 3D video sequences of test subjects and facilitates interactive generation of novel facial expressions is described. Dynamic 3D video sequences are generated using computational binocular stereo matching with active illumination and are used for interactive expression modeling. An individual’s 3D video set is annotated with...

Two recent advances—the use of functionally gradient materials in parts and layered manufacturing technology— have brought to the forefront the need for design and fabrication methodologies for heterogeneous objects. However, current solid modeling systems, a core component of computer-aided design and fabrication tools, are typically purely geometry based, and only after the modeling of produc...

In this paper, I will provide an overview of our project on 3D object and face modeling from images taken by a free-moving camera. We strive to advance the state of the art in 3D computer vision, and develop flexible and robust techniques for ordinary users to gain 3D experience from a set of casually collected 2D images. Applications include product advertisement on the Web, virtual conference...

It is very important for virtual character designers to generate 3D face models interactively and creatively in real-time. This paper investigates the use of sketch-based interface in 3D face modeling and focuses on how to map 2D sketchy features onto a 3D model. A mapping mechanism on the basis of contour lines is proposed. Representative points of the input are extracted, which retain the glo...

Ruizhe Wang*, Matthias Hernandez*, Jongmoo Choi, Gérard Medioni Computer Vision Lab, IRIS University of Southern California Abstract In this paper, we address the problem of both face and body modeling using a single fixed low-cost 3D camera (e.g. Kinect). Unlike other scanning technologies which either set up multiple sensors around a static subject or scan the static subject with a hand-held ...

Abstract Real-time face tracking and modeling from video have been a challenge in computer graphics and computer vision for many years. And it is widely used in the field of virtual reality such as Human-Machine interaction, computer games and film, virtual showman, etc. The two issues of real-time face tracking and modeling should be taken into consideration: how to generate facial features in...

3D Face modeling is still one of the biggest challenges in computer graphics. In this paper we present a novel framework that acquires the 3D shape, texture, pose and illumination of a face from a single photograph. Additionally, we show how we can recreate a face under varying illumination conditions. Or, essentially relight it. Using a custom-built face scanning system, we have collected 3D f...

This paper presents a part-based face detection approach where the spatial relationship between the face parts is represented by a hidden 3D model with six parameters. The computational complexity of the search in the six dimensional pose space is addressed by proposing meaningful 3D pose candidates by image-based regression from detected face keypoint locations. The 3D pose candidates are eval...