NDLI: Leveraging depth cameras and wearable pressure sensors for full-body kinematics and dynamics capture

Content Provider	ACM Digital Library
Author	Liu, C. Karen Zhang, Peizhao Zhang, Jianjie Chai, Jinxiang Siu, Kristin
Copyright Year	2014
Abstract	We present a new method for full-body motion capture that uses input data captured by three depth cameras and a pair of pressure-sensing shoes. Our system is appealing because it is low-cost, non-intrusive and fully automatic, and can accurately reconstruct both full-body kinematics and dynamics data. We first introduce a novel tracking process that automatically reconstructs 3D skeletal poses using input data captured by three $\textit{Kinect}$ cameras and wearable pressure sensors. We formulate the problem in an optimization framework and incrementally update 3D skeletal poses with observed depth data and pressure data via iterative linear solvers. The system is highly accurate because we integrate depth data from multiple depth cameras, foot pressure data, detailed full-body geometry, and environmental contact constraints into a unified framework. In addition, we develop an efficient physics-based motion reconstruction algorithm for solving internal joint torques and contact forces in the quadratic programming framework. During reconstruction, we leverage Newtonian physics, friction cone constraints, contact pressure information, and 3D kinematic poses obtained from the kinematic tracking process to reconstruct full-body dynamics data. We demonstrate the power of our approach by capturing a wide range of human movements and achieve state-of-the-art accuracy in our comparison against alternative systems.
Starting Page	1
Ending Page	14
Page Count	14
File Format	PDF
ISSN	07300301
e-ISSN	15577368
DOI	10.1145/2661229.2661286
Volume Number	33
Issue Number	6
Journal	ACM Transactions on Graphics (TOG)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2014-11-19
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Full body shape modeling Human body tracking Motion capture Physics-based modeling
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Leveraging Depth Cameras and Wearable Pressure Sensors for Full-body Kinematics and Dynamics Capture

Leveraging Depth Cameras and Wearable Pressure Sensors for Full-body Kinematics and Dynamics Capture

Accurate realtime full-body motion capture using a single depth camera

Motion capture from body-mounted cameras

Three-dimensional modeling from two-dimensional video

Personalization and Evaluation of a Real-Time Depth-Based Full Body Tracker

MoSh: motion and shape capture from sparse markers

Motion Imitation with a Handheld Camera

VideoMocap: modeling physically realistic human motion from monocular video sequences

Leveraging depth cameras and wearable pressure sensors for full-body kinematics and dynamics capture

Similar Documents

Leveraging Depth Cameras and Wearable Pressure Sensors for Full-body Kinematics and Dynamics Capture

Leveraging Depth Cameras and Wearable Pressure Sensors for Full-body Kinematics and Dynamics Capture

Accurate realtime full-body motion capture using a single depth camera

Motion capture from body-mounted cameras

Three-dimensional modeling from two-dimensional video

Personalization and Evaluation of a Real-Time Depth-Based Full Body Tracker

MoSh: motion and shape capture from sparse markers

Motion Imitation with a Handheld Camera

VideoMocap: modeling physically realistic human motion from monocular video sequences

Leveraging depth cameras and wearable pressure sensors for full-body kinematics and dynamics capture