NDLI: Video-based 3D motion capture through biped control

Content Provider	ACM Digital Library
Author	Vondrak, Marek Hodgins, Jessica Jenkins, Odest Sigal, Leonid
Copyright Year	2012
Abstract	Marker-less motion capture is a challenging problem, particularly when only monocular video is available. We estimate human motion from monocular video by recovering three-dimensional controllers capable of implicitly simulating the observed human behavior and replaying this behavior in other environments and under physical perturbations. Our approach employs a state-space biped controller with a balance feedback mechanism that encodes control as a sequence of simple control tasks. Transitions among these tasks are triggered on time and on proprioceptive events $(\textit{e.g}.,$ contact). Inference takes the form of optimal control where we optimize a high-dimensional vector of control parameters and the structure of the controller based on an objective function that compares the resulting simulated motion with input observations. We illustrate our approach by automatically estimating controllers for a variety of motions directly from monocular video. We show that the estimation of controller structure through incremental optimization and refinement leads to controllers that are more stable and that better approximate the reference motion. We demonstrate our approach by capturing sequences of walking, jumping, and gymnastics.
Starting Page	1
Ending Page	12
Page Count	12
File Format	PDF
ISSN	07300301
e-ISSN	15577368
DOI	10.1145/2185520.2185523
Volume Number	31
Issue Number	4
Journal	ACM Transactions on Graphics (TOG)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2012-07-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Bipedal control Video-based motion capture
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Data-driven biped control

Video-based hand manipulation capture through composite motion control

Simulating biped behaviors from human motion data

Simulating biped behaviors from human motion data

Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture

Real-Time Physics-Based 3D Biped Character Animation Using an Inverted Pendulum Model

VideoMocap: modeling physically realistic human motion from monocular video sequences

Planning biped locomotion using motion capture data and probabilistic roadmaps

Dynamic response for motion capture animation

Video-based 3D motion capture through biped control

Similar Documents

Data-driven biped control

Video-based hand manipulation capture through composite motion control

Simulating biped behaviors from human motion data

Simulating biped behaviors from human motion data

Hybrid Skeletal-Surface Motion Graphs for Character Animation from 4D Performance Capture

Real-Time Physics-Based 3D Biped Character Animation Using an Inverted Pendulum Model

VideoMocap: modeling physically realistic human motion from monocular video sequences

Planning biped locomotion using motion capture data and probabilistic roadmaps

Dynamic response for motion capture animation

Video-based 3D motion capture through biped control