NDLI: Best practices for learning video concept detectors from social media examples

Content Provider	Springer Nature Link
Author	Kordumova, Svetlana Li, Xirong Sek, Cees G. M.
Copyright Year	2014
Abstract	Learning video concept detectors from social media sources, such as Flickr images and YouTube videos, has the potential to address a wide variety of concept queries for video search. While the potential has been recognized by many, and progress on the topic has been impressive, we argue that key questions crucial to know how to learn effective video concept detectors from social media examples? remain open. As an initial attempt to answer these questions, we conduct an experimental study using a video search engine which is capable of learning concept detectors from social media examples, be it socially tagged videos or socially tagged images. Within the video search engine we investigate three strategies for positive example selection, three negative example selection strategies and three learning strategies. The performance is evaluated on the challenging TRECVID 2012 benchmark consisting of 600 h of Internet video. From the experiments we derive four best practices: (1) tagged images are a better source for learning video concepts than tagged videos, (2) selecting tag relevant positive training examples is always beneficial, (3) selecting relevant negative examples is advantageous and should be treated differently for video and image sources, and (4) learning concept detectors with selected relevant training data before learning is better then incorporating the relevance during the learning process. The best practices within our video search engine lead to state-of-the-art performance in the TRECVID 2013 benchmark for concept detection without manually provided annotations.
Starting Page	1291
Ending Page	1315
Page Count	25
File Format	PDF
ISSN	13807501
Journal	Multimedia Tools and Applications
Volume Number	74
Issue Number	4
e-ISSN	15737721
Language	English
Publisher	Springer US
Publisher Date	2014-05-23
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Video retrieval Concept Detection Social media Multimedia Information Systems Computer Communication Networks Data Structures, Cryptology and Information Theory Special Purpose and Application-Based Systems
Content Type	Text
Resource Type	Article
Subject	Computer Networks and Communications Hardware and Architecture Software Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A framework for improved video text detection and recognition

Multimodal concept detection in broadcast media: KavTan

Interactive multi-user video retrieval systems

Simulating the future of concept-based video retrieval under improved detector performance

Automatic Video Database Indexing and Retrieval

Guest editorial: Event-based video analysis/retrieval

A Language for Content-Based Video Retrieval

Fast shared boosting for large-scale concept detection

Fuzzy reasoning framework to improve semantic video interpretation

Best practices for learning video concept detectors from social media examples

Similar Documents

A framework for improved video text detection and recognition

Multimodal concept detection in broadcast media: KavTan

Interactive multi-user video retrieval systems

Simulating the future of concept-based video retrieval under improved detector performance

Automatic Video Database Indexing and Retrieval

Guest editorial: Event-based video analysis/retrieval

A Language for Content-Based Video Retrieval

Fast shared boosting for large-scale concept detection

Fuzzy reasoning framework to improve semantic video interpretation

Best practices for learning video concept detectors from social media examples