NDLI: On the coupled use of signal and semantic concepts to bridge the semantic and user intention gaps for visual content retrieval

Content Provider	Springer Nature Link
Author	Belkhatir, M. Jarrar, R.
Copyright Year	2016
Abstract	The effectiveness of image indexing and retrieval systems has been negatively impacted by both the semantic and user intention gaps. The first is related to the challenge of characterizing the visual semantic information through low-level extracted features (color, texture...) while the second highlights the difficulty for human users to convey their search intents using the traditional relevance feedback or query-by-example visual query mechanisms. We address both issues by highlighting vocabularies of visual concepts that are mapped to extracted low-level features through an automated learning paradigm. These are then instantiated within a semantic indexing and retrieval framework based on a Bayesian model considering the joint distribution of visual and semantic concepts. To address the user intention gap and enrich the expressiveness of the retrieval module, visual and semantic concepts can be coupled within text-based queries. We are therefore able to process both single-concept queries such as the state-of-the-art solutions but also topic-based queries, i.e. non-trivial queries involving multiple characterizations of the visual content. We evaluate our proposal in a precision/recall based evaluation framework on the IAPR-TC 12 benchmark dataset.
Starting Page	165
Ending Page	172
Page Count	8
File Format	PDF
ISSN	21926611
Journal	International Journal of Multimedia Information Retrieval
Volume Number	5
Issue Number	3
e-ISSN	2192662X
Language	English
Publisher	Springer London
Publisher Date	2016-07-14
Publisher Place	London
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	User intention gap Visual content retrieval Semantic gap Information Storage and Retrieval Data Mining and Knowledge Discovery Image Processing and Computer Vision Computer Science Information Systems Applications (incl. Internet) Multimedia Information Systems Signal and semantic concepts
Content Type	Text
Resource Type	Article
Subject	Library and Information Sciences Information Systems Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Leveraging visual concepts and query performance prediction for semantic-theme-based video retrieval

Automatic environmental sound concepts discovery for video retrieval

Special issue on visual information retrieval

New grand challenge for multimedia information retrieval: bridging the utility gap

Top multimedia information retrieval papers

Semantics-based selection of everyday concepts in visual lifelogging

Text-to-video: a semantic search engine for internet videos

Optimizing visual dictionaries for effective image retrieval

Detection of social events in streams of social multimedia

On the coupled use of signal and semantic concepts to bridge the semantic and user intention gaps for visual content retrieval

Similar Documents

Leveraging visual concepts and query performance prediction for semantic-theme-based video retrieval

Automatic environmental sound concepts discovery for video retrieval

Special issue on visual information retrieval

New grand challenge for multimedia information retrieval: bridging the utility gap

Top multimedia information retrieval papers

Semantics-based selection of everyday concepts in visual lifelogging

Text-to-video: a semantic search engine for internet videos

Optimizing visual dictionaries for effective image retrieval

Detection of social events in streams of social multimedia

On the coupled use of signal and semantic concepts to bridge the semantic and user intention gaps for visual content retrieval