NDLI: Bilinear heterogeneous information machine for RGB-D action recognition

Content Provider	IEEE Xplore Digital Library
Author	Yu Kong Yun Fu
Copyright Year	2015
Description	Author affiliation: Dept. of Electr. & Comput. Eng., Northeastern Univ., Boston, MA, USA (Yu Kong; Yun Fu)
Abstract	This paper proposes a novel approach to action recognition from RGB-D cameras, in which depth features and RGB visual features are jointly used. Rich heterogeneous RGB and depth data are effectively compressed and projected to a learned shared space, in order to reduce noise and capture useful information for recognition. Knowledge from various sources can then be shared with others in the learned space to learn cross-modal features. This guides the discovery of valuable information for recognition. To capture complex spatiotemporal structural relationships in visual and depth features, we represent both RGB and depth data in a matrix form. We formulate the recognition task as a low-rank bilinear model composed of row and column parameter matrices. The rank of the model parameter is minimized to build a low-rank classifier, which is beneficial for improving the generalization power. The proposed method is extensively evaluated on two public RGB-D action datasets, and achieves state-of-the-art results. It also shows promising results if RGB or depth data are missing in training or testing procedure.
Starting Page	1054
Ending Page	1062
File Size	827007
Page Count	9
File Format	PDF
ISSN	10636919
e-ISBN	9781467369640
DOI	10.1109/CVPR.2015.7298708
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-06-07
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Computational modeling Spatiotemporal phenomena Visualization Noise Feature extraction Training Cameras
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Spatiotemporal Deformable Part Models for Action Detection

Action Recognition with Actons

Bilinear Heterogeneous Information Machine for RGB-D Action Recognition

Semi-supervised Learning for RGB-D Object Recognition

Jointly learning heterogeneous features for RGB-D activity recognition

Recognizing RGB Images by Learning from RGB-D Data

Slow Feature Analysis for Human Action Recognition

From Actemes to Action: A Strongly-Supervised Representation for Detailed Action Understanding

Superpixel tracking

Bilinear heterogeneous information machine for RGB-D action recognition

Similar Documents

Spatiotemporal Deformable Part Models for Action Detection

Action Recognition with Actons

Bilinear Heterogeneous Information Machine for RGB-D Action Recognition

Semi-supervised Learning for RGB-D Object Recognition

Jointly learning heterogeneous features for RGB-D activity recognition

Recognizing RGB Images by Learning from RGB-D Data

Slow Feature Analysis for Human Action Recognition

From Actemes to Action: A Strongly-Supervised Representation for Detailed Action Understanding

Superpixel tracking

Bilinear heterogeneous information machine for RGB-D action recognition