NDLI: 3D Human Motion Analysis in Monocular Video Techniques and Challenges

Content Provider	IEEE Xplore Digital Library
Author	Sminchisescu, C.
Copyright Year	2006
Description	Author affiliation: TTI-C, USA (Sminchisescu, C.)
Abstract	Human motion and action analysis in video is an actively growing field with a broad spectrum of applications including video browsing and indexing, entertainment, virtual reality, human-computer interaction and surveillance. However, human motion analysis systems face important scientific and computational challenges. The proportions of the human body vary across individuals due to gender, weight, age or race. Aside from this variability, any single human body has many degrees of freedom due to articulation and the individual limbs are deformable due to muscle and clothing. Finally many realworld scenes involve multiple interacting humans occluded by each other or by other objects, and the scene conditions may also vary due to the camera motion or lighting changes. These factors make accurate 3D human models difficult to build and difficult to reconstruct reliably from ?flat? 2D images. During this talk I will discuss learning and inference algorithms for estimating 3D human motion in monocular video. While the problem has been traditionally approached using the powerful machinery of generative models, operating in an analysis by synthesis loop, the main emphasis of this talk will be on an emerging class of complementary discriminative temporal estimation models. These can be viewed as upside down, bottom-up versions of classical temporal models used with Kalman filtering or particle filtering. But instead of inverting a generative imaging model, we will learn to cooperatively predict complex, feedforward 2D-to-3D mappings, using Conditional Bayesian Mixtures of Experts. These are embedded in a probabilistic temporal framework in order to enforce dynamic constraints and allow a principled propagation of uncertainty. We call the resulting model BM3E (a Conditional Bayesian Mixture of Experts Markov Model). During the talk, I will discuss how inference can be restricted, for efficiency, to low-dimensional non-linear state spaces, and how the framework can be extended in order to deal with clutter and occlusion. I will also discuss the relative advantages of generative and initialize and recover from failure.
Starting Page	76
Ending Page	76
File Size	120680
Page Count	1
File Format	PDF
ISBN	0769526888
DOI	10.1109/AVSS.2006.3
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2006-11-22
Publisher Place	Australia
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Filtering Bayesian methods Surveillance Layout Humans Virtual reality Muscles Face Motion analysis Indexing
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Model-based human motion analysis in monocular video

3D Human Motion Analysis in Monocular Video -- Techniques and Challenges (2007)

Navigating in Manhattan: 3D orientation from video without correspondences

Motion indexing of video

A Bayesian framework for 3D human motion tracking from monocular image

Detecting contextual anomalies of crowd motion in surveillance video

CFBOX/sup TM/: superimposing 3D human face on motion picture

Real time tracking of multiple persons by Kalman filtering and face pursuit for multimedia applications

Automatic construction of 3D human face models based on 2D images

3D Human Motion Analysis in Monocular Video Techniques and Challenges

Similar Documents

Model-based human motion analysis in monocular video

3D Human Motion Analysis in Monocular Video -- Techniques and Challenges (2007)

Navigating in Manhattan: 3D orientation from video without correspondences

Motion indexing of video

A Bayesian framework for 3D human motion tracking from monocular image

Detecting contextual anomalies of crowd motion in surveillance video

CFBOX/sup TM/: superimposing 3D human face on motion picture

Real time tracking of multiple persons by Kalman filtering and face pursuit for multimedia applications

Automatic construction of 3D human face models based on 2D images

3D Human Motion Analysis in Monocular Video Techniques and Challenges