NDLI: Joint-Rerank: a novel method for image search reranking

Content Provider	Springer Nature Link
Author	Hou, Hong Mei Xu, Xin Shun Wang, Gang Wang, Xiao Lin
Copyright Year	2014
Abstract	Image search reranking which aims to improve the text-based image search results with the help of other cues has grown into a hot research topic. Most existing reranking methods only focus on image visual cues. However, the visual cues cannot always guarantee to provide enough information for the reranking process. Although, some approaches try to fuse multiple image cues for reranking, they do not or weakly exploit the relationships among multiple image cues. In this paper,we present a novel image reranking framework—Joint-Rerank which considers multiple modalities of images (or multiple cues) jointly as interdependent attributes of an image entity. Joint-Rerank models the images as a multigraph where each image is a node with multimodal attributes (textual and visual cues) and the parallel edges between nodes measure both image intra-modal and inter-modal similarities. Besides, each node has a “self-consistency” that measures how much the multiple modalities of an image may be consistent. To solve the reranking problem, we first degenerate the multigraph into a new complete graph, and then employ a random walk on the degenerated graph to propagate the relevance scores of each node. Finally, the relevance scores of multiple modalities are fused to rank the images. Moreover, in Joint-Rerank, “cross-modal” walk is possible, i.e., a surfer can jump from one image to another following both intra-modal and inter-modal links. In this framework, we propose two methods: Sym-Joint-Rerank and Asym-Joint-Rerank which use different approaches to measure the inter-modal similarities between two nodes. Experimental results on a large web queries dataset which contains 353 image search queries show that both of them are superior or highly competitive to several state-of-the-art reranking algorithms.
Starting Page	1423
Ending Page	1442
Page Count	20
File Format	PDF
ISSN	13807501
Journal	Multimedia Tools and Applications
Volume Number	74
Issue Number	4
e-ISSN	15737721
Language	English
Publisher	Springer US
Publisher Date	2014-04-17
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Joint-Rerank Multimodal fusion Image search Random walk Graph model Multimedia Information Systems Computer Communication Networks Data Structures, Cryptology and Information Theory Special Purpose and Application-Based Systems
Content Type	Text
Resource Type	Article
Subject	Computer Networks and Communications Hardware and Architecture Software Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Graph-based multimodal clustering for social multimedia

Leveraging community metadata for multimodal image ranking

Binary code reranking method with weighted hamming distance

MQSS: multimodal query suggestion and searching for video search

Multimodal information fusion application to human emotion recognition from face and speech

Improving group recommendations via detecting comprehensive correlative information

Editorial Note: Multimodal Data Fusion, Learning and Applications

Mobile multi-view object image search

Multimodal joint information processing in human machine interaction: recent advances

Joint-Rerank: a novel method for image search reranking

Similar Documents

Graph-based multimodal clustering for social multimedia

Leveraging community metadata for multimodal image ranking

Binary code reranking method with weighted hamming distance

MQSS: multimodal query suggestion and searching for video search

Multimodal information fusion application to human emotion recognition from face and speech

Improving group recommendations via detecting comprehensive correlative information

Editorial Note: Multimodal Data Fusion, Learning and Applications

Mobile multi-view object image search

Multimodal joint information processing in human machine interaction: recent advances

Joint-Rerank: a novel method for image search reranking