NDLI: Scale-Invariant Visual Language Modeling for Object Categorization

Content Provider	IEEE Xplore Digital Library
Author	Lei Wu Yang Hu Mingjing Li Nenghai Yu Xian-Sheng Hua
Copyright Year	1999
Abstract	In recent years, ldquobag-of-wordsrdquo models, which treat an image as a collection of unordered visual words, have been widely applied in the multimedia and computer vision fields. However, their ignorance of the spatial structure among visual words makes them indiscriminative for objects with similar word frequencies but different word spatial distributions. In this paper, we propose a visual language modeling method (VLM), which incorporates the spatial context of the local appearance features into the statistical language model. To represent the object categories, models with different orders of statistical dependencies have been exploited. In addition, the multilayer extension to the VLM makes it more resistant to scale variations of objects. The model is effective and applicable to large scale image categorization. We train scale invariant visual language models based on the images which are grouped by Flickr tags, and use these models for object categorization. Experimental results show they achieve better performance than single layer visual language models and ldquobag-of-wordsrdquo models. They also achieve comparable performance with 2-D MHMM and SVM-based methods, while costing much less computational time.
Sponsorship	IEEE Signal Processing Society IEEE Circuits and Systems Society IEEE Communications Society IEEE Computer Society
Starting Page	286
Ending Page	294
Page Count	9
File Size	1445896
File Format	PDF
ISSN	15209210
Volume Number	11
Issue Number	2
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-02-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Computer vision Context modeling Image retrieval Data mining Image analysis Frequency Nonhomogeneous media Large-scale systems Costing Content based retrieval visual language model content-based image retrieval image classification
Content Type	Text
Resource Type	Article
Subject	Signal Processing Electrical and Electronic Engineering Computer Science Applications Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Spatial context for visual vocabulary construction

Object Retrieval Using Visual Query Context

A Graphical Model for Context-Aware Visual Content Recommendation

Genre-specific modeling of visual features for efficient content based video shot classification and retrieval

TFIDF, LSI and multi-word in information retrieval and text categorization

Fusing Local Image Descriptors for Large-Scale Image Retrieval

Narrowing the semantic gap - improved text-based web document retrieval using visual features

Multi-Bin search: improved large-scale content-based image retrieval

Improving Content Based Image Retrieval using Scale Invariant Feature Transform

Scale-Invariant Visual Language Modeling for Object Categorization

Similar Documents

Spatial context for visual vocabulary construction

Object Retrieval Using Visual Query Context

A Graphical Model for Context-Aware Visual Content Recommendation

Genre-specific modeling of visual features for efficient content based video shot classification and retrieval

TFIDF, LSI and multi-word in information retrieval and text categorization

Fusing Local Image Descriptors for Large-Scale Image Retrieval

Narrowing the semantic gap - improved text-based web document retrieval using visual features

Multi-Bin search: improved large-scale content-based image retrieval

Improving Content Based Image Retrieval using Scale Invariant Feature Transform

Scale-Invariant Visual Language Modeling for Object Categorization