This paper introduces statistical parsing of video programs using hidden Markov models (HMMs). The fundamental units of a video program are shots and transitions (fades, dissolves, etc.). Those units are in turn used to create more complex structures, such as scenes. Parsing a video allows us to recognize higher-level story abstractions—dialog sequences, transitional scenes, etc. These higher-l...

The eye gaze behavior of individuals changes depending on their knowledge and experience of the event occurring in their field of view. In past studies, researchers formulated a hypothesis concerning this dependency on a specific scene and then analyzed the gaze behavior of viewers observing the scene. We depart from this hypothesis-testing paradigm. In this paper, we propose a datamining frame...

In this paper we will present a novel approach of using surface patches for Image Based Rendering. Based on image sequences acquired with a freely moving portable multi-camera-rig we can extrapolate novel views of complex real scenes in realtime. The cameras are calibrated from the image sequence itself and dense depth maps are computed for each camera view using an improved multiview depth est...

In the present paper we propose a new algorithm for planar facets segmentation of sequences of uncali-brated images in order to recover 3D models of complex scenes. This is performed using a two steps algorithm. First a robust and regularized dense disparity eld is computed under the epipolar geometry constraint. The resulting eld is segmented according to homographic models using an iterative ...

We present a three-step approach for the detection of 3D planes in image sequences of complex architectural scenes. In the first step 3D features (points or lines) are extracted from the images. A large number of potential planes are then fitted to the features in a second step. In the third step the relevant planes are selected with an algorithm based on the Minimum Description Length (MDL) pr...

This paper investigates the task of identifying frequently-used pathways from video sequences of natural outdoor scenes. Path models are adaptively learnt from the accumulation of trajectory data over many image frames. Labelled paths are used as an efficient means for compressing the trajectory data for logging purposes. In addition, the path models are used to predict the object’s location ma...

While a large number of virtual reality applications, such as fluid flow analysis and molecular modeling, deal with simulated data, many newer applications attempt to recreate true reality as convincingly as possible. Building detailed models for such applications, which we call tele-reality, is a major bottleneck holding back their deployment. In this paper, we present techniques for automatic...

This paper deals with the issue of synchronization of a multi camera system observing dynamic scenes. The developed method presented is not based on the use of local image features that are in general not robust to possible occlusions and noise. Instead, a new approach is introduced allowing a temporal alignment of video sequences using the analysis of moving object traces in scenes in the freq...

Initiation, Response, and Feedback(IRF) sequences are the most frequent interaction network in any classroom contexts. IRF sequences have been examined profusely in previous studies and were reported to be negatively correlated with participation opportunities (Kasper, 2006; Cazden, 2001; Ellis, 1994).In all these studies, all contingent factors of any classroom context which might influence in...