NDLI: Cluster encoding for modelling temporal variation in video

Content Provider	IEEE Xplore Digital Library
Author	Rostamzadeh, N. Uijlings, J. Mironica, I. Abadi, M.K. Ionescu, B. Sebe, N.
Copyright Year	2015
Description	Author affiliation: CALVIN Group, Univ. of Edinburgh, Edinburgh, UK (Uijlings, J.) \|\| Univ. of Trento, Trento, Italy (Rostamzadeh, N.; Abadi, M.K.; Sebe, N.) \|\| LAPI, Univ. Politeh. of Bucharest, Bucharest, Romania (Mironica, I.; Ionescu, B.)
Abstract	Classical Bag-of-Words methods represent videos by modeling the variation of local visual descriptors throughout the video. In this approach they mix variation in time and space indiscriminately while these dimensions are fundamentally different. Therefore, in this paper we present a novel method for video representation which explicitly captures temporal variation over time. We do this by first creating frame-based features using standard Bag-of-Words techniques. To model the variation in time over these frame-based features, we introduce Hard and Soft Cluster Encoding, novel techniques to model variation inspired by the Fisher Kernel [1] and VLAD [2]. Results on the Rochester ADL [3] and Blip10k [4] datasets show that our method yields improvements of respectively 6.6% and 7.4% over our baselines. On Blip10k we outperform the state-of-the-art by 3.6% when using only visual features.
Starting Page	3640
Ending Page	3644
File Size	712838
Page Count	5
File Format	PDF
e-ISBN	9781479983391
DOI	10.1109/ICIP.2015.7351483
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-09-27
Publisher Place	Canada
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Encoding Kernel Standards Hidden Markov models Visualization Histograms Vocabulary video classification modeling temporal variation in video temporal Fisher Kernel encoding temporal VLAD encoding
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Multi-video browsing and summarization

A Bag-of-Pages Approach to Unordered Multi-page Document Classification

Large-scale web video event classification by use of Fisher Vectors

Spatio-temporal Context Modeling for BoW-Based Video Classification

CLUSTER ENCODING FOR MODELLING TEMPORAL VARIATION IN VIDEO

Using the Fisher kernel method for Web audio classification

Spatial-temporal correlation for trajectory based action video retrieval

Temporal Sequence Modeling for Video Event Detection

Beyond Bag-of-Words: Fast video classification with Fisher Kernel Vector of Locally Aggregated Descriptors

Cluster encoding for modelling temporal variation in video

Similar Documents

Multi-video browsing and summarization

A Bag-of-Pages Approach to Unordered Multi-page Document Classification

Large-scale web video event classification by use of Fisher Vectors

Spatio-temporal Context Modeling for BoW-Based Video Classification

CLUSTER ENCODING FOR MODELLING TEMPORAL VARIATION IN VIDEO

Using the Fisher kernel method for Web audio classification

Spatial-temporal correlation for trajectory based action video retrieval

Temporal Sequence Modeling for Video Event Detection

Beyond Bag-of-Words: Fast video classification with Fisher Kernel Vector of Locally Aggregated Descriptors

Cluster encoding for modelling temporal variation in video