NDLI: Real-Time Visual Concept Classification

Content Provider	IEEE Xplore Digital Library
Author	Uijlings, J.R.R. Smeulders, A.W.M. Scha, R.J.H.
Copyright Year	1999
Abstract	As datasets grow increasingly large in content-based image and video retrieval, computational efficiency of concept classification is important. This paper reviews techniques to accelerate concept classification, where we show the trade-off between computational efficiency and accuracy. As a basis, we use the Bag-of-Words algorithm that in the 2008 benchmarks of TRECVID and PASCAL lead to the best performance scores. We divide the evaluation in three steps: 1) Descriptor Extraction, where we evaluate SIFT, SURF, DAISY, and Semantic Textons. 2) Visual Word Assignment, where we compare a k-means visual vocabulary with a Random Forest and evaluate subsampling, dimension reduction with PCA, and division strategies of the Spatial Pyramid. 3) Classification, where we evaluate the χ², RBF, and Fast Histogram Intersection kernel for the SVM. Apart from the evaluation, we accelerate the calculation of densely sampled SIFT and SURF, accelerate nearest neighbor assignment, and improve accuracy of the Histogram Intersection kernel. We conclude by discussing whether further acceleration of the Bag-of-Words pipeline is possible. Our results lead to a 7-fold speed increase without accuracy loss, and a 70-fold speed increase with 3% accuracy loss. The latter system does classification in real-time, which opens up new applications for automatic concept classification. For example, this system permits five standard desktop PCs to automatically tag for 20 classes all images that are currently uploaded to Flickr.
Sponsorship	IEEE Signal Processing Society IEEE Circuits and Systems Society IEEE Communications Society IEEE Computer Society
Starting Page	665
Ending Page	681
Page Count	17
File Size	1585518
File Format	PDF
ISSN	15209210
Volume Number	12
Issue Number	7
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-11-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Acceleration Computational efficiency Histograms Kernel Information retrieval Image retrieval Content based retrieval Vocabulary Principal component analysis Support vector machines real-time Bag-of-words computational efficiency evaluation image/video retrieval
Content Type	Text
Resource Type	Article
Subject	Signal Processing Electrical and Electronic Engineering Computer Science Applications Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Empowering Visual Categorization With the GPU

An Enhanced Bag-of-Visual Word Vector Space Model to Represent Visual Content in Athletics Images

Contextual Bag-of-Words for Visual Categorization

Fast Visual Retrieval Using Accelerated Sequence Matching

Approximate Image Matching using Strings of Bag-of-Visual Words Representation

Weighting scheme for image retrieval based on bag-of-visual-words

Efficient Scale- and Rotation-Invariant Encoding of Visual Words for Image Classification

Which Components are Important for Interactive Image Searching?

Video Annotation and Retrieval Using Ontologies and Rule Learning

Real-Time Visual Concept Classification

Similar Documents

Empowering Visual Categorization With the GPU

An Enhanced Bag-of-Visual Word Vector Space Model to Represent Visual Content in Athletics Images

Contextual Bag-of-Words for Visual Categorization

Fast Visual Retrieval Using Accelerated Sequence Matching

Approximate Image Matching using Strings of Bag-of-Visual Words Representation

Weighting scheme for image retrieval based on bag-of-visual-words

Efficient Scale- and Rotation-Invariant Encoding of Visual Words for Image Classification

Which Components are Important for Interactive Image Searching?

Video Annotation and Retrieval Using Ontologies and Rule Learning

Real-Time Visual Concept Classification