NDLI: Efficient Visual Search of Videos Cast as Text Retrieval

Content Provider	IEEE Xplore Digital Library
Author	Sivic, J. Zisserman, A.
Copyright Year	1979
Abstract	We describe an approach to object retrieval which searches for and localizes all the occurrences of an object in a video, given a query image of the object. The object is represented by a set of viewpoint invariant region descriptors so that recognition can proceed successfully despite changes in viewpoint, illumination and partial occlusion. The temporal continuity of the video within a shot is used to track the regions in order to reject those that are unstable. Efficient retrieval is achieved by employing methods from statistical text retrieval, including inverted file systems, and text and document frequency weightings. This requires a visual analogy of a word which is provided here by vector quantizing the region descriptors. The final ranking also depends on the spatial layout of the regions. The result is that retrieval is immediate, returning a ranked list of shots in the manner of Google. We report results for object retrieval on the full length feature films 'Groundhog Day', 'Casablanca' and 'Run Lola Run', including searches from within the movie and specified by external images downloaded from the Internet. We investigate retrieval performance with respect to different quantizations of region descriptors and compare the performance of several ranking measures.
Sponsorship	IEEE Computer Society
Page Count	16
File Size	6308439
Starting Page	591
Ending Page	606
File Format	PDF
ISSN	01628828
Volume Number	31
Issue Number	4
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-04-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Videos Image retrieval Lighting Text recognition Image databases Nearest neighbor searches File systems Frequency Motion pictures Internet Image/video retrieval Object recognition
Content Type	Text
Resource Type	Article
Subject	Applied Mathematics Artificial Intelligence Computational Theory and Mathematics Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Approximate Nearest Subspace Search

Efficient Visual Search for Objects in Videos

Product Quantization for Nearest Neighbor Search

The Inverted Multi-Index

BoostMap: An Embedding Method for Efficient Nearest Neighbor Retrieval

Nearest neighbor search for relevance feedback

Tiny Videos: A Large Data Set for Nonparametric Video Retrieval and Frame Classification

Tiny Videos: A Large Dataset for Image and Video Frame Categorization

Improving Bag-of-Features for Large Scale Image Search

Efficient Visual Search of Videos Cast as Text Retrieval

Similar Documents

Approximate Nearest Subspace Search

Efficient Visual Search for Objects in Videos

Product Quantization for Nearest Neighbor Search

The Inverted Multi-Index

BoostMap: An Embedding Method for Efficient Nearest Neighbor Retrieval

Nearest neighbor search for relevance feedback

Tiny Videos: A Large Data Set for Nonparametric Video Retrieval and Frame Classification

Tiny Videos: A Large Dataset for Image and Video Frame Categorization

Improving Bag-of-Features for Large Scale Image Search

Efficient Visual Search of Videos Cast as Text Retrieval