Movie is a kind of complex video with rich content. The analysis of movie is more complicated than other types of videos like surveillance, sport games, and documentaries. In this paper, a statistical approach using hidden Markov model to classify movie scenes is proposed. Two important kinds of movie scenes, dialogue and fighting scenes, are classified. Color and motion features are extracted ...

AbstractWhat does human pose tell us about a scene? We propose task to answer this question: given as input, hallucinate compatible scene. Subtle cues captured by pose—action semantics, environment affordances, object interactions—provide surprising insight into which scenes are compatible. present large-scale generative adversarial network for pose-conditioned scene generation. significantly s...

We present a system for converting a fully panoramic (360◦) video into a normal field-of-view (NFOV) hyperlapse for an optimal viewing experience. Our system exploits visual saliency and semantics to non-uniformly sample in space and time for generating hyperlapses. In addition, users can optionally choose objects of interest for customizing the hyperlapses. We first stabilize an input 360◦ vid...

An online process is proposed for video registration of dynamic scenes, such as scenes with dynamic textures or with moving objects. This process has three steps: (i) A few frames are assumed to be already registered. (ii) Using the registered frames, the next new frame is extrapolated. (iii) The actual new frame is registered to the extrapolated frame. Video extrapolation overcomes the bias in...

In this work we aim to predict the driver’s focus of attention. The goal is to estimate what a person would pay attention to while driving, and which part of the scene around the vehicle is more critical for the task. To this end we propose a new computer vision model based on a multi-path deep architecture that integrates three sources of information: visual cues, motion and scene semantics. W...

Modern graphic/programming tools like Unity enables the possibility of creating 3D scenes as well as making 3D scene based program applications, including full physical model, motion, sounds, lightning effects etc. This paper deals with the usage of dynamic frames based generator in the automatic generation of 3D scene and related source code. The suggested model enables the possibility to spec...

In this paper, an efficient video content representation is proposed using optimal extraction of characteristic frames and scenes. This representation, apart from providing browsing capabilities to digital video databases, also allows more efficient content-based queries and indexing. For performing the frame/scene extraction, a feature vector formulation of the images is proposed based on colo...

View-dependent rendering allows interactive visualization of larger scenes. A well-known artifact is the popping problem in animations resulting from temporal differences in the level of detail between the view-dependent representations used in subsequent frames. We solve the popping problem by computing view-dependent representations of a scene only at every n-th frame, and smoothly interpolat...

The object people perceive in an image can depend on its orientation relative to the scene it is in (its reference frame). For example, the images of the symbols × and + differ by a 45 degree rotation. Although real scenes have multiple images and reference frames, psychologists have focused on scenes with only one reference frame. We propose an ideal observer model based on nonparametric Bayes...