NDLI: Extended conceptual feedback for semantic multimedia indexing

Content Provider	Springer Nature Link
Author	Hamadi, Abdelkader Mulhem, Philippe Quét, Georges
Copyright Year	2014
Abstract	In this paper, we consider the problem of automatically detecting a large number of visual concepts in images or video shots. State of the art systems generally involve feature (descriptor) extraction, classification (supervised learning) and fusion when several descriptors and/or classifiers are used. Though direct multi-label approaches are considered in some works, detection scores are often computed independently for each target concept. We propose a method that we call “conceptual feedback” which implicitly takes into account the relations between concepts to improve the overall concepts detection performance. A conceptual descriptor is built from the system’s output scores and fed back by adding it to the pool of already available descriptors. Our proposal can be iterated several times. Moreover, we propose three extensions of our method. Firstly, a weighting of the conceptual dimensions is performed to give more importance to concepts which are more correlated to the target concept. Secondly, an explicit selection of a set of concepts that are semantically or statically related to the target concept is introduced. For video indexing, we propose a third extension which integrates the temporal dimension in the feedback process by taking into account simultaneously the conceptual and the temporal dimensions to build the high-level descriptor. Our proposals have been evaluated in the context of the TRECVid 2012 semantic indexing task involving the detection of 346 visual or multi-modal concepts. Overall, combined with temporal re-scoring, the proposed method increased the global system performance (MAP) from 0.2613 to 0.3082 ( + 17.9 % of relative improvement) while the temporal re-scoring alone increased it only from 0.2613 to 0.2691 ( + 3.0 %).
Starting Page	1225
Ending Page	1248
Page Count	24
File Format	PDF
ISSN	13807501
Journal	Multimedia Tools and Applications
Volume Number	74
Issue Number	4
e-ISSN	15737721
Language	English
Publisher	Springer US
Publisher Date	2014-04-15
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Semantic indexing Multimedia Fusion Conceptual feedback Inter-concepts relationships Ontology Temporal context Semantic context TRECVid Multimedia Information Systems Computer Communication Networks Data Structures, Cryptology and Information Theory Special Purpose and Application-Based Systems
Content Type	Text
Resource Type	Article
Subject	Computer Networks and Communications Hardware and Architecture Software Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

An ontology-based evidential framework for video indexing using high-level multimodal fusion

A comparative study for multiple visual concepts detection in images and videos

Two-layers re-ranking approach based on contextual information for visual concepts detection in videos

A generic framework for semantic video indexing based on visual concepts/contexts detection

Fuzzy reasoning framework to improve semantic video interpretation

Semantic representation of multimedia content: Knowledge representation and semantic indexing

Multimedia ontology matching by using visual and textual modalities

Ontology-Based Semantic Indexing for MPEG-7 and TV-Anytime Audiovisual Content

Ontology based user query interpretation for semantic multimedia contents retrieval

Extended conceptual feedback for semantic multimedia indexing

Similar Documents

An ontology-based evidential framework for video indexing using high-level multimodal fusion

A comparative study for multiple visual concepts detection in images and videos

Two-layers re-ranking approach based on contextual information for visual concepts detection in videos

A generic framework for semantic video indexing based on visual concepts/contexts detection

Fuzzy reasoning framework to improve semantic video interpretation

Semantic representation of multimedia content: Knowledge representation and semantic indexing

Multimedia ontology matching by using visual and textual modalities

Ontology-Based Semantic Indexing for MPEG-7 and TV-Anytime Audiovisual Content

Ontology based user query interpretation for semantic multimedia contents retrieval

Extended conceptual feedback for semantic multimedia indexing