NDLI: Video Co-segmentation for Meaningful Action Extraction

Content Provider	IEEE Xplore Digital Library
Author	Jiaming Guo Zhuwen Li Loong-Fah Cheong Zhou, S.Z.
Copyright Year	2013
Description	Author affiliation: Dept. of ECE, Nat. Univ. of Singapore, Singapore, Singapore (Jiaming Guo; Zhuwen Li; Loong-Fah Cheong; Zhou, S.Z.)
Abstract	Given a pair of videos having a common action, our goal is to simultaneously segment this pair of videos to extract this common action. As a preprocessing step, we first remove background trajectories by a motion-based figure ground segmentation. To remove the remaining background and those extraneous actions, we propose the trajectory co saliency measure, which captures the notion that trajectories recurring in all the videos should have their mutual saliency boosted. This requires a trajectory matching process which can compare trajectories with different lengths and not necessarily spatiotemporally aligned, and yet be discriminative enough despite significant intra-class variation in the common action. We further leverage the graph matching to enforce geometric coherence between regions so as to reduce feature ambiguity and matching errors. Finally, to classify the trajectories into common action and action outliers, we formulate the problem as a binary labeling of a Markov Random Field, in which the data term is measured by the trajectory co-saliency and the smoothness term is measured by the spatiotemporal consistency between trajectories. To evaluate the performance of our framework, we introduce a dataset containing clips that have animal actions as well as human actions. Experimental results show that the proposed method performs well in common action extraction.
Sponsorship	IEEE Comput. Soc.
Starting Page	2232
Ending Page	2239
File Size	2601808
Page Count	8
File Format	PDF
ISBN	9781479928408
ISSN	15505499
DOI	10.1109/ICCV.2013.278
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-12-01
Publisher Place	Australia
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Trajectory Spatiotemporal phenomena Labeling Motion segmentation Coherence Histograms Computer vision
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Video figure ground labeling

A spatiotemporal motion model for video summarization

View-Invariant 3D Action Recognition Using Spatiotemporal Self-Similarities from Depth Camera

Motionlets: Mid-level 3D Parts for Human Motion Recognition

Video Segmentation Descriptors for Event Recognition

Action recognition with trajectory-pooled deep-convolutional descriptors

Weakly Supervised Multiclass Video Segmentation

Cross-dataset action detection

Human activity recognition from frame’s spatiotemporal representation

Video Co-segmentation for Meaningful Action Extraction

Similar Documents

Video figure ground labeling

A spatiotemporal motion model for video summarization

View-Invariant 3D Action Recognition Using Spatiotemporal Self-Similarities from Depth Camera

Motionlets: Mid-level 3D Parts for Human Motion Recognition

Video Segmentation Descriptors for Event Recognition

Action recognition with trajectory-pooled deep-convolutional descriptors

Weakly Supervised Multiclass Video Segmentation

Cross-dataset action detection

Human activity recognition from frame’s spatiotemporal representation

Video Co-segmentation for Meaningful Action Extraction