NDLI: Learning unified sparse representations for multi-modal data

Content Provider	IEEE Xplore Digital Library
Author	Kaiye Wang Wei Wang Liang Wang
Copyright Year	2015
Description	Author affiliation: Center for Res. on Intell. Perception & Comput., Inst. of Autom., Beijing, China (Kaiye Wang; Wei Wang; Liang Wang)
Abstract	Cross-modal retrieval has become one of interesting and important research problem recently, where users can take one modality of data (e.g., text, image or video) as the query to retrieve relevant data of another modality. In this paper, we present a Multi-modal Unified Representation Learning (MURL) algorithm for cross-modal retrieval, which learns unified sparse representations for multi-modal data representing the same semantics via joint dictionary learning. The $ℓ_{1}-norm$ is imposed on the unified representations to explicitly encourage sparsity, which makes our algorithm more robust. Furthermore, a constraint regularization term is imposed to force the representations to be similar if their corresponding multi-modal data have must-links or to be far apart if their corresponding multi-modal data have cannot-links. An iterative algorithm is also proposed to solve the objective function. The effectiveness of the proposed method is verified by extensive results on two real-world datasets.
Starting Page	3545
Ending Page	3549
File Size	777012
Page Count	5
File Format	PDF
e-ISBN	9781479983391
DOI	10.1109/ICIP.2015.7351464
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-09-27
Publisher Place	Canada
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Dictionaries Electronic publishing Internet Optimization Semantics Linear programming multi-modal data Cross-modal retrieval unified representation learning joint dictionary learning
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Coupled dictionary learning and feature mapping for cross-modal retrieval

Dictionary Learning Based Hashing for Cross-Modal Retrieval

Fast Multi-Modal Unified Sparse Representation Learning

Blockwise coordinate descent schemes for sparse representation

Learning a discriminative dictionary for locality constrained coding and sparse representation

Online multi-modal task-driven dictionary learning and robust joint sparse representation for visual tracking

An L1 criterion for dictionary learning by subspace identification

Cross-Modality Submodular Dictionary Learning for Information Retrieval

Semi-supervised Coupled Dictionary Learning for Cross-modal Retrieval in Internet Images and Texts

Learning unified sparse representations for multi-modal data

Similar Documents

Coupled dictionary learning and feature mapping for cross-modal retrieval

Dictionary Learning Based Hashing for Cross-Modal Retrieval

Fast Multi-Modal Unified Sparse Representation Learning

Blockwise coordinate descent schemes for sparse representation

Learning a discriminative dictionary for locality constrained coding and sparse representation

Online multi-modal task-driven dictionary learning and robust joint sparse representation for visual tracking

An L1 criterion for dictionary learning by subspace identification

Cross-Modality Submodular Dictionary Learning for Information Retrieval

Semi-supervised Coupled Dictionary Learning for Cross-modal Retrieval in Internet Images and Texts

Learning unified sparse representations for multi-modal data