NDLI: Event Recognition in Photo Collections with a Stopwatch HMM

Content Provider	IEEE Xplore Digital Library
Author	Bossard, L. Guillaumin, M. Van, L.
Copyright Year	2013
Description	Author affiliation: Comput. Vision Lab., ETH Zurich, Zurich, Switzerland (Bossard, L.; Guillaumin, M.; Van, L.)
Abstract	The task of recognizing events in photo collections is central for automatically organizing images. It is also very challenging, because of the ambiguity of photos across different event classes and because many photos do not convey enough relevant information. Unfortunately, the field still lacks standard evaluation data sets to allow comparison of different approaches. In this paper, we introduce and release a novel data set of personal photo collections containing more than 61,000 images in 807 collections, annotated with 14 diverse social event classes. Casting collections as sequential data, we build upon recent and state-of-the-art work in event recognition in videos to propose a latent sub-event approach for event recognition in photo collections. However, photos in collections are sparsely sampled over time and come in bursts from which transpires the importance of specific moments for the photographers. Thus, we adapt a discriminative hidden Markov model to allow the transitions between states to be a function of the time gap between consecutive images, which we coin as Stopwatch Hidden Markov model (SHMM). In our experiments, we show that our proposed model outperforms approaches based only on feature pooling or a classical hidden Markov model. With an average accuracy of 56%, we also highlight the difficulty of the data set and the need for future advances in event recognition in photo collections.
Sponsorship	IEEE Comput. Soc.
Starting Page	1193
Ending Page	1200
File Size	1397350
Page Count	8
File Format	PDF
ISBN	9781479928408
ISSN	15505499
DOI	10.1109/ICCV.2013.151
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-12-01
Publisher Place	Australia
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Hidden Markov models Visualization Videos Support vector machines Predictive models Complexity theory Markov processes
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Parsing Videos of Actions with Segmental Grammars

Mixture of Support Vector Machines for HMM based Speech Recognition

Pattern recognition of chatter gestation based on SVM — HMM method

How Related Exemplars Help Complex Event Detection in Web Videos?

Motion Part Regularization: Improving action recognition via trajectory group selection

ACTIVE: Activity Concept Transitions in Video Event Classification

Embedding HMM’s-based models in a Euclidean space: The topological hidden Markov models

Visual speech recognition with loosely synchronized feature streams

Stochastic Segment Model Adaptation for Offline Handwriting Recognition

Event Recognition in Photo Collections with a Stopwatch HMM

Similar Documents

Parsing Videos of Actions with Segmental Grammars

Mixture of Support Vector Machines for HMM based Speech Recognition

Pattern recognition of chatter gestation based on SVM — HMM method

How Related Exemplars Help Complex Event Detection in Web Videos?

Motion Part Regularization: Improving action recognition via trajectory group selection

ACTIVE: Activity Concept Transitions in Video Event Classification

Embedding HMM’s-based models in a Euclidean space: The topological hidden Markov models

Visual speech recognition with loosely synchronized feature streams

Stochastic Segment Model Adaptation for Offline Handwriting Recognition

Event Recognition in Photo Collections with a Stopwatch HMM