NDLI: Geo-Temporal Mining and Searching of Events from Web-based Image Collections

Content Provider	ACM Digital Library
Author	Ruocco, Massimiliano
Abstract	The proliferation of Web- and social media-based photo-sharing applications have not only opened many possibilities but also resulted in new needs and challenges. They have resulted in a large amount of personal photos being available for public access. One of the most interesting characteristics of these data is that they are surrounded by 1) textual annotations, also called tags, which are intended to describe and categorize, by collective user efforts, the uploaded resources 2) temporal information referring to when a pictures has been taken and often by 3) a locational information describing where the picture has been taken. Despite the recent developments and technological advances in Web-based mediasharing applications, the continuously increasing amount of available information has made the access to the photos a demanding task. In general, we can address this challenge by allowing photo collections to be organized and browsed through the concept of events. We also believe most users are familiar with searching photo collections using events as starting points. Aiming at supporting the detection and search of event-related photos, this thesis proposes a novel framework for extracting pictures related to real-life events from a collection of Web-images by leveraging on their temporal geographical and textual annotations and comparing the proposed approach with existing related state-of-the-art approaches. Second, a set of geographical features is proposed describing the characteristics of the geographical profile of query terms deriving concepts from exploratory analysis. Third, the thesis provides two different tag-based search framework to improve the effectiveness of searching images related to events. The first framework is based on temporal and geographical proximity of query terms to the temporal neighbours of a given timestamped query, while the second framework is based on a novel machine-learning based query expansion method combining the heterogeneous textual, temporal and geographical similarity between query terms and candidate expansion terms for the selection of the expansion terms given a free text textual query. All the proposed methods have been evaluated by performing extensive experiments on real data gathered from media-sharing applications on the Web. Where possible, comparison with related techniques has been performed to reinforce the validity of the presented approaches. The proposed methods have shown promising results in both the extraction and clustering of event-related images and searching event-related pictures by using metrics from the state of the art. This doctoral work has been performed at the Department of Computer and Information Science at the Norwegian University of Science and Technology (NTNU) under advise of Associate Professor Heri Ramampiaro and with co-supervisors Associate Professor Roger Midtstraum and Associate Professor Randi Karlsen. Professor Ramesh Jain (University of California Irvine), Assistant Professor Claudia Hauff (TU Delft) and Associate Professor Trond Aalberg (NTNU) served as dissertation committee members. Available online at: http://www.idi.ntnu.no/research/doctor_theses/ruocco.pdf.
Starting Page	119
Ending Page	120
Page Count	2
File Format	PDF
ISSN	01635840
DOI	10.1145/2701583.2701603
Journal	ACM SIGIR Forum (SIGF)
Volume Number	48
Issue Number	2
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	1978-08-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Content Type	Text
Resource Type	Article
Subject	Management Information Systems Hardware and Architecture

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Geo-temporal mining and searching of events from web-based image collections.

Geo-temporal mining and searching of events from web-based image collections (2014).

Searching and mining the web for personalized and specialized information

Searching Distributed Collections With Inference Networks

Do TREC web collections look like the web?

Improving non-English web searching (iNEWS07)

U.S. versus European web searching trends

Multitasking, cognitive coordination and cognitive shifts during web searching

Using Local Popularity of Web Resources for Geo-Ranking of Search Engine Results

Geo-Temporal Mining and Searching of Events from Web-based Image Collections

Similar Documents

Geo-temporal mining and searching of events from web-based image collections.

Geo-temporal mining and searching of events from web-based image collections (2014).

Searching and mining the web for personalized and specialized information

Searching Distributed Collections With Inference Networks

Do TREC web collections look like the web?

Improving non-English web searching (iNEWS07)

U.S. versus European web searching trends

Multitasking, cognitive coordination and cognitive shifts during web searching

Using Local Popularity of Web Resources for Geo-Ranking of Search Engine Results

Geo-Temporal Mining and Searching of Events from Web-based Image Collections