NDLI: On the tag localization of web video

Content Provider	Springer Nature Link
Author	Li, Haojie Liu, Bin Yi, Lei Guan, Yue Luo, Zhong Xuan
Copyright Year	2014
Abstract	Nowadays, numerous social videos have pervaded on the web. Social web videos are characterized with the accompanying rich contextual information which describe the content of videos and thus greatly facilitate video search and browsing. Generally, those contextual data such as tags are provided at the whole video level, without temporal indication of when they actually appear in the video, let alone the spatial annotation of object related tags in the video frames. However, many tags only describe parts of the video content. Therefore, tag localization, the process of assigning tags to the underlying relevant video segments or frames even regions in frames is gaining increasing research interests and a benchmark dataset for the fair evaluation of tag localization algorithms is highly desirable. In this paper, we describe and release a dataset called DUT-WEBV, which contains about 4,000 videos collected from YouTube portal by issuing 50 concepts as queries. These concepts cover a wide range of semantic aspects including scenes like “mountain”, events like “flood”, objects like “cows”, sites like “gas station”, and activities like “handshaking”, offering great challenges to the tag (i.e., concept) localization task. For each video of a tag, we carefully annotate the time durations when the tag appears in the video and also label the spatial location of object with mask in frames for object related tag. Besides the video itself, the contextual information, such as thumbnail images, titles, and YouTube categories, is also provided. Together with this benchmark dataset, we present a baseline for tag localization using multiple instance learning approach. Finally, we discuss some open research issues for tag localization in web videos.
Starting Page	405
Ending Page	412
Page Count	8
File Format	PDF
ISSN	09424962
Journal	Multimedia Systems
Volume Number	22
Issue Number	4
e-ISSN	14321882
Language	English
Publisher	Springer Berlin Heidelberg
Publisher Date	2014-08-07
Publisher Place	Berlin, Heidelberg
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Video annotation Tag localization Video retrieval Multimedia Information Systems Computer Communication Networks Operating Systems Data Storage Representation Data Encryption Computer Graphics
Content Type	Text
Resource Type	Article
Subject	Computer Networks and Communications Information Systems Media Technology Hardware and Architecture Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Tag relevance fusion for social image retrieval

Systems and architectures for multimedia information retrieval

Scalable search-based image annotation

Collaborative video searching on a tabletop

Relevance ranking in georeferenced video search

Interactive multimedia computing

The Continuous Media Web: a distributed multimedia information retrieval architecture extending the World Wide Web

Social video annotation by combining features with a tri-adaptation approach

Semantic user profiling techniques for personalised multimedia recommendation

On the tag localization of web video

Similar Documents

Tag relevance fusion for social image retrieval

Systems and architectures for multimedia information retrieval

Scalable search-based image annotation

Collaborative video searching on a tabletop

Relevance ranking in georeferenced video search

Interactive multimedia computing

The Continuous Media Web: a distributed multimedia information retrieval architecture extending the World Wide Web

Social video annotation by combining features with a tri-adaptation approach

Semantic user profiling techniques for personalised multimedia recommendation

On the tag localization of web video