NDLI: Detection of social events in streams of social multimedia

Please wait, while we are loading the content...

Detection of social events in streams of social multimedia

Content Provider	Springer Nature Link
Author	Niranjan, Mahesan Gibbins, Nicholas Samangooei, Sina Hare, Jonathon
Copyright Year	2015
Abstract	Combining items from social media streams, such as Flickr photos and Twitter tweets, into meaningful groups can help users contextualise and consume more effectively the torrents of information continuously being made available on the social web. This task is made challenging due to the scale of the streams and the inherently multimodal nature of the information being contextualised. The problem of grouping social media items into meaningful groups can be seen as an ill-posed and application specific unsupervised clustering problem. A fundamental question in multimodal contexts is determining which features best signify that two items should belong to the same grouping. This paper presents a methodology which approaches social event detection as a streaming multi-modal clustering task. The methodology takes advantage of the temporal nature of social events and as a side benefit, allows for scaling to real-world datasets. Specific challenges of the social event detection task are addressed: the engineering and selection of the features used to compare items to one another; a feature fusion strategy that incorporates relative importance of features; the construction of a single sparse affinity matrix; and clustering techniques which produce meaningful item groups whilst scaling to cluster very large numbers of items. The state-of-the-art approach presented here is evaluated using the ReSEED dataset with standardised evaluation measures. With automatically learned feature weights, we achieve an $${F}_1$$ score of 0.94, showing that a good compromise between precision and recall of clusters can be achieved. In a comparison with other state-of-the-art algorithms our approach is shown to give the best results.
Starting Page	289
Ending Page	302
Page Count	14
File Format	PDF
ISSN	21926611
Journal	International Journal of Multimedia Information Retrieval
Volume Number	4
Issue Number	4
e-ISSN	2192662X
Language	English
Publisher	Springer London
Publisher Date	2015-08-26
Publisher Place	London
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Clustering methods Scalability User-generated content Social event detection Information Storage and Retrieval Data Mining and Knowledge Discovery Image Processing and Computer Vision Computer Science Information Systems Applications (incl. Internet) Multimedia Information Systems
Content Type	Text
Resource Type	Article
Subject	Library and Information Sciences Information Systems Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

High-level event recognition in unconstrained videos

On the use of commonsense ontology for multimedia event recounting

Beyond audio and video retrieval: topic-oriented multimedia summarization

Text-to-video: a semantic search engine for internet videos

MGraph: multimodal event summarization in social media using topic models and graph-based ranking

Weakly supervised detection of video events using hidden conditional random fields

Top multimedia information retrieval papers

Content analysis meets viewers: linking concept detection with demographics on YouTube

Multimedia information retrieval: best papers and expanding frontiers

Detection of social events in streams of social multimedia

Similar Documents

High-level event recognition in unconstrained videos

On the use of commonsense ontology for multimedia event recounting

Beyond audio and video retrieval: topic-oriented multimedia summarization

Text-to-video: a semantic search engine for internet videos

MGraph: multimodal event summarization in social media using topic models and graph-based ranking

Weakly supervised detection of video events using hidden conditional random fields

Top multimedia information retrieval papers

Content analysis meets viewers: linking concept detection with demographics on YouTube

Multimedia information retrieval: best papers and expanding frontiers

Detection of social events in streams of social multimedia