NDLI: Coupled Action Recognition and Pose Estimation from Multiple Views

Content Provider	Springer Nature Link
Author	Yao, Angela Gall, Juergen Gool, Luc
Copyright Year	2012
Abstract	Action recognition and pose estimation are two closely related topics in understanding human body movements; information from one task can be leveraged to assist the other, yet the two are often treated separately. We present here a framework for coupled action recognition and pose estimation by formulating pose estimation as an optimization over a set of action-specific manifolds. The framework allows for integration of a 2D appearance-based action recognition system as a prior for 3D pose estimation and for refinement of the action labels using relational pose features based on the extracted 3D poses. Our experiments show that our pose estimation system is able to estimate body poses with high degrees of freedom using very few particles and can achieve state-of-the-art results on the HumanEva-II benchmark. We also thoroughly investigate the impact of pose estimation and action recognition accuracy on each other on the challenging TUM kitchen dataset. We demonstrate not only the feasibility of using extracted 3D poses for action recognition, but also improved performance in comparison to action recognition using low-level appearance features.
Starting Page	16
Ending Page	37
Page Count	22
File Format	PDF
ISSN	09205691
Journal	International Journal of Computer Vision
Volume Number	100
Issue Number	1
e-ISSN	15731405
Language	English
Publisher	Springer US
Publisher Date	2012-05-30
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Human pose estimation Human action recognition Tracking Stochastic optimization Hough transform Computer Imaging, Vision, Pattern Recognition and Graphics Pattern Recognition Artificial Intelligence (incl. Robotics) Image Processing and Computer Vision
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Coupled Visual and Kinematic Manifold Models for Tracking

Loose-limbed People: Estimating 3D Human Pose and Motion Using Non-parametric Belief Propagation

Using Segmented 3D Point Clouds for Accurate Likelihood Approximation in Human Pose Tracking

Pose Adaptive Motion Feature Pooling for Human Action Analysis

Demisting the Hough Transform for 3D Shape Recognition and Registration

Upper Body Detection and Tracking in Extended Signing Sequences

Poselet-Based Contextual Rescoring for Human Pose Estimation via Pictorial Structures

Robust Pose Recognition of the Obscured Human Body

2D Articulated Human Pose Estimation and Retrieval in (Almost) Unconstrained Still Images

Coupled Action Recognition and Pose Estimation from Multiple Views

Similar Documents

Coupled Visual and Kinematic Manifold Models for Tracking

Loose-limbed People: Estimating 3D Human Pose and Motion Using Non-parametric Belief Propagation

Using Segmented 3D Point Clouds for Accurate Likelihood Approximation in Human Pose Tracking

Pose Adaptive Motion Feature Pooling for Human Action Analysis

Demisting the Hough Transform for 3D Shape Recognition and Registration

Upper Body Detection and Tracking in Extended Signing Sequences

Poselet-Based Contextual Rescoring for Human Pose Estimation via Pictorial Structures

Robust Pose Recognition of the Obscured Human Body

2D Articulated Human Pose Estimation and Retrieval in (Almost) Unconstrained Still Images

Coupled Action Recognition and Pose Estimation from Multiple Views