NDLI: On the use of commonsense ontology for multimedia event recounting

Content Provider	Springer Nature Link
Author	Tan, Chun Chet Ngo, Chong Wah
Copyright Year	2015
Abstract	Textually narrating the observed evidences relevant to the reasons why a video clip is being retrieved for an event is still a highly challenging problem. This paper explores the use of a commonsense ontology, namely ConceptNet, in generating short descriptions for recounting the audio–visual evidences. The ontology is exploited as a knowledge engine to provide event–relevant common sense, which is expressed in terms of concepts and their relationships, for semantics understanding, context-based concept screening and sentence synthesis. A principal way of exploiting the ontology, from extracting the event–relevant semantic network to the formation of syntactic parse trees, is outlined and discussed. Experimental results on two benchmark datasets (TRECVID MED and MediaEval) show the effectiveness of our approach. The findings show insights on the usability of common sense for multimedia search, including the feasibility of inferring relevant concepts for event detection, as well as the quality of textual sentences in meeting human expectation.
Starting Page	73
Ending Page	88
Page Count	16
File Format	PDF
ISSN	21926611
Journal	International Journal of Multimedia Information Retrieval
Volume Number	5
Issue Number	2
e-ISSN	2192662X
Language	English
Publisher	Springer London
Publisher Date	2015-11-30
Publisher Place	London
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Event recounting Event detection Ontology Information Storage and Retrieval Data Mining and Knowledge Discovery Image Processing and Computer Vision Computer Science Information Systems Applications (incl. Internet) Multimedia Information Systems
Content Type	Text
Resource Type	Article
Subject	Library and Information Sciences Information Systems Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Beyond audio and video retrieval: topic-oriented multimedia summarization

Top multimedia information retrieval papers

Acquisition of multimedia ontology: an application in preservation of cultural heritage

MGraph: multimodal event summarization in social media using topic models and graph-based ranking

High-level event recognition in unconstrained videos

Detection of social events in streams of social multimedia

Special issue on video retrieval

Multimedia information retrieval: best papers and expanding frontiers

Multimedia information retrieval in the twenty-first century

On the use of commonsense ontology for multimedia event recounting

Similar Documents

Beyond audio and video retrieval: topic-oriented multimedia summarization

Top multimedia information retrieval papers

Acquisition of multimedia ontology: an application in preservation of cultural heritage

MGraph: multimodal event summarization in social media using topic models and graph-based ranking

High-level event recognition in unconstrained videos

Detection of social events in streams of social multimedia

Special issue on video retrieval

Multimedia information retrieval: best papers and expanding frontiers

Multimedia information retrieval in the twenty-first century

On the use of commonsense ontology for multimedia event recounting