NDLI: Modeling Geometric-Temporal Context With Directional Pyramid Co-Occurrence for Action Recognition

Content Provider	IEEE Xplore Digital Library
Author	Chunfeng Yuan Xi Li Weiming Hu Haibin Ling Maybank, S.J.
Copyright Year	1992
Abstract	In this paper, we present a new geometric-temporal representation for visual action recognition based on local spatio-temporal features. First, we propose a modified covariance descriptor under the log-Euclidean Riemannian metric to represent the spatio-temporal cuboids detected in the video sequences. Compared with previously proposed covariance descriptors, our descriptor can be measured and clustered in Euclidian space. Second, to capture the geometric-temporal contextual information, we construct a directional pyramid co-occurrence matrix (DPCM) to describe the spatio-temporal distribution of the vector-quantized local feature descriptors extracted from a video. DPCM characterizes the co-occurrence statistics of local features as well as the spatio-temporal positional relationships among the concurrent features. These statistics provide strong descriptive power for action recognition. To use DPCM for action recognition, we propose a directional pyramid co-occurrence matching kernel to measure the similarity of videos. The proposed method achieves the state-of-the-art performance and improves on the recognition performance of the bag-of-visual-words (BOVWs) models by a large margin on six public data sets. For example, on the KTH data set, it achieves 98.78% accuracy while the BOVW approach only achieves 88.06%. On both Weizmann and UCF CIL data sets, the highest possible accuracy of 100% is achieved.
Sponsorship	IEEE Signal Processing Society
Starting Page	658
Ending Page	672
Page Count	15
File Size	3570968
File Format	PDF
ISSN	10577149
Volume Number	23
Issue Number	2
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Covariance matrices Feature extraction Vectors Measurement Three-dimensional displays Video sequences Kernel action recognition Covariance cuboid descriptor log-Euclidean Riemannian metric spatio-temporal directional pyramid co-occurrence matrix kernel machine
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Action Recognition From Video Using Feature Covariance Matrices

Manifold Kernel Sparse Representation of Symmetric Positive-Definite Matrices and Its Applications

Detecting Human Action as the Spatio-Temporal Tube of Maximum Mutual Information

Log-Euclidean bag of words for human action recognition

Spatio-Temporal Laplacian Pyramid Coding for Action Recognition

A variational method for contour tracking via covariance matching

Image classification based on log-Euclidean Fisher Vectors for covariance matrix descriptors

Image classification based on log-Euclidean Fisher Vectors for covariance matrix descriptors

Band-Reweighed Gabor Kernel Embedding for Face Image Representation and Recognition

Modeling Geometric-Temporal Context With Directional Pyramid Co-Occurrence for Action Recognition

Similar Documents

Action Recognition From Video Using Feature Covariance Matrices

Manifold Kernel Sparse Representation of Symmetric Positive-Definite Matrices and Its Applications

Detecting Human Action as the Spatio-Temporal Tube of Maximum Mutual Information

Log-Euclidean bag of words for human action recognition

Spatio-Temporal Laplacian Pyramid Coding for Action Recognition

A variational method for contour tracking via covariance matching

Image classification based on log-Euclidean Fisher Vectors for covariance matrix descriptors

Image classification based on log-Euclidean Fisher Vectors for covariance matrix descriptors

Band-Reweighed Gabor Kernel Embedding for Face Image Representation and Recognition

Modeling Geometric-Temporal Context With Directional Pyramid Co-Occurrence for Action Recognition