NDLI: Extracting a fluid dynamic texture and the background from video

Content Provider	IEEE Xplore Digital Library
Author	Ghanem, B. Ahuja, N.
Copyright Year	2008
Description	Author affiliation: Dept. of Electr. & Comput. Eng., Univ. of Illinois at Urbana-Champaign, Urbana, IL (Ghanem, B.; Ahuja, N.)
Abstract	Given the video of a still background occluded by a fluid dynamic texture (FDT), this paper addresses the problem of separating the video sequence into its two constituent layers. One layer corresponds to the video of the unoccluded background, and the other to that of the dynamic texture, as it would appear if viewed against a black background. The model of the dynamic texture is unknown except that it represents fluid flow. We present an approach that uses the image motion information to simultaneously obtain a model of the dynamic texture and separate it from the background which is required to be still. Previous methods have considered occluding layers whose dynamics follows simple motion models (e.g. periodic or 2D parametric motion). FDTs considered in this paper exhibit complex stochastic motion. We consider videos showing an FDT layer (e.g. pummeling smoke or heavy rain) in front of a static background layer (e.g. brick building). We propose a novel method for simultaneously separating these two layers and learning a model for the FDT. Due to the fluid nature of the DT, we are required to learn a model for both the spatial appearance and the temporal variations (due to changes in density) of the FDT, along with a valid estimate of the background. We model the frames of a sequence as being produced by a continuous HMM, characterized by transition probabilities based on the Navier-Stokes equations for fluid dynamics, and by generation probabilities based on the convex matting of the FDT with the background. We learn the FDT appearance, the FDT temporal variations, and the background by maximizing their joint probability using interactive conditional modes (ICM). Since the learned model is generative, it can be used to synthesize new videos with different backgrounds and density variations. Experiments on videos that we compiled demonstrate the performance of our method.
Starting Page	1
Ending Page	8
File Size	3431730
Page Count	8
File Format	PDF
ISBN	9781424422425
ISSN	10636919
DOI	10.1109/CVPR.2008.4587547
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2008-06-23
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Fluid dynamics Hidden Markov models Video sequences Rain Navier-Stokes equations Character generation Layout Filters Fluid flow Stochastic processes
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A stochastic filter for fluid motion tracking

Dynamic texture recognition

Navier-stokes, fluid dynamics, and image and video inpainting

A new way to use hidden Markov models for object tracking in video sequences

Extracting a Fluid Dynamic Texture and the Background from Video

Extracting a fluid dynamic texture and the background from video.

Dynamic texture classification using dynamic fractal analysis

Behaviour understanding in video: a combined method

JPDAF based HMM for real-time contour tracking

Extracting a fluid dynamic texture and the background from video

Similar Documents

A stochastic filter for fluid motion tracking

Dynamic texture recognition

Navier-stokes, fluid dynamics, and image and video inpainting

A new way to use hidden Markov models for object tracking in video sequences

Extracting a Fluid Dynamic Texture and the Background from Video

Extracting a fluid dynamic texture and the background from video.

Dynamic texture classification using dynamic fractal analysis

Behaviour understanding in video: a combined method

JPDAF based HMM for real-time contour tracking

Extracting a fluid dynamic texture and the background from video