NDLI: Joint optimisation convex-negative matrix factorisation for multi-modal image collection summarisation based on images and tags

Content Provider	IET Digital Library
Author	Zhang, Wenkai Fu, Kun Sun, Xian Zhang, Yuhang Sun, Hao Wang, Hongqi
Abstract	Image collection summarisation aims to represent a large-scale multi-modal collection with a small subset of images and tags, helping navigate a large image dataset. Most extant methods leverage the contributions of text-to-visual summaries, ignoring the visual contribution to the textual topic. When the tags are weakly labelled, the textual topic cannot accurately reflect the visual summary. To solve this, the authors propose a novel model, joint optimisation of convex non-negative matrix factorisation, which incorporates images and tags in a beneficial way. The objective function contains visual and textual error functions, sharing the same indicator matrix, connecting different modal relations. Then, they propose an iterative algorithm to optimise the proposed model. Finally, they explore the effects of different visual feature representations (e.g. bag-of-words and deep learning) on multi-modal collection summary. Our proposed method is then compared with state-of-the-art algorithms using two multi-modal datasets (i.e. MIRFlickr and NUS-WIDE-SCENE). Experimental results demonstrate the effectiveness of their proposed approach.
Starting Page	125
Ending Page	130
Page Count	6
ISSN	17519632
Volume Number	13
e-ISSN	17519640
Issue Number	Issue 2, Mar (2019)
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/iet-cvi/13/2
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/10.1049/iet-cvi.2017.0568
Journal	IET Computer Vision
Publisher Date	2018-04-09
Access Restriction	Open
Rights Holder	© The Institution of Engineering and Technology
Subject Keyword	Computer Vision And Image Processing Technique Convex Programming Image Dataset Image Representation Interpolation And Function Approximation Iterative Algorithm Iterative Method Joint Optimisation Convex-negative Matrix Factorisation Matrix Decomposition Multimodal Collection Summary Multimodal Image Collection Summarisation Numerical Analysis Objective Function Optical, Image And Video Signal Processing Optimisation Technique Text-to-visual Summaries Textual Error Function Visual Error Function Visual Feature Representations
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Automatic image annotation by a loosely joint non-negative matrix factorisation

Efficient method for finding globally optimal solution of problem with weighted Lp norm and L 2 norm objective function

Video summarisation with visual and semantic cues

Optimising compressive sensing matrix using Chicken Swarm Optimisation algorithm

Non-local feature back-projection for image super-resolution

Gaussian mixture image restoration based on maximum correntropy criterion

Solder joint image adaptive block compressive sensing with convex optimisation and Gini index

Bregman inverse filter

L1-norm based discriminant manifold learning for multi-label image classification

Joint optimisation convex-negative matrix factorisation for multi-modal image collection summarisation based on images and tags

Similar Documents

Automatic image annotation by a loosely joint non-negative matrix factorisation

Efficient method for finding globally optimal solution of problem with weighted Lp norm and L 2 norm objective function

Video summarisation with visual and semantic cues

Optimising compressive sensing matrix using Chicken Swarm Optimisation algorithm

Non-local feature back-projection for image super-resolution

Gaussian mixture image restoration based on maximum correntropy criterion

Solder joint image adaptive block compressive sensing with convex optimisation and Gini index

Bregman inverse filter

L1-norm based discriminant manifold learning for multi-label image classification

Joint optimisation convex-negative matrix factorisation for multi-modal image collection summarisation based on images and tags