NDLI: Recognize complex events from static images by fusing deep channels

Content Provider	IEEE Xplore Digital Library
Author	Yuanjun Xiong Kai Zhu Dahua Lin Xiaoou Tang
Copyright Year	2015
Description	Author affiliation: Dept. of Inf. Eng., Chinese Univ. of Hong Kong, Hong Kong, China (Yuanjun Xiong; Kai Zhu; Dahua Lin; Xiaoou Tang)
Abstract	A considerable portion of web images capture events that occur in our personal lives or social activities. In this paper, we aim to develop an effective method for recognizing events from such images. Despite the sheer amount of study on event recognition, most existing methods rely on videos and are not directly applicable to this task. Generally, events are complex phenomena that involve interactions among people and objects, and therefore analysis of event photos requires techniques that can go beyond recognizing individual objects and carry out joint reasoning based on evidences of multiple aspects. Inspired by the recent success of deep learning, we formulate a multi-layer framework to tackle this problem, which takes into account both visual appearance and the interactions among humans and objects, and combines them via semantic fusion. An important issue arising here is that humans and objects discovered by detectors are in the form of bounding boxes, and there is no straightforward way to represent their interactions and incorporate them with a deep network. We address this using a novel strategy that projects the detected instances onto multi-scale spatial maps. On a large dataset with 60, 000 images, the proposed method achieved substantial improvement over the state-of-the-art, raising the accuracy of event recognition by over 10%.
Starting Page	1600
Ending Page	1609
File Size	829525
Page Count	10
File Format	PDF
ISSN	10636919
e-ISBN	9781467369640
DOI	10.1109/CVPR.2015.7298768
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-06-07
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Detectors Visualization Image recognition Semantics Face Videos Feature extraction
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Recognize complex events from static images by fusing deep channels (2015)

Identifying players in broadcast sports videos using conditional random fields

Inferring social relations from visual concepts

Recognize Human Activities from Partially Observed Videos

Efficient Boosted Exemplar-Based Face Detection

Weakly supervised semantic segmentation for social images

Social Role Discovery in Human Events

Mid-level deep pattern mining

Fusing Robust Face Region Descriptors via Multiple Metric Learning for Face Recognition in the Wild

Recognize complex events from static images by fusing deep channels

Similar Documents

Recognize complex events from static images by fusing deep channels (2015)

Identifying players in broadcast sports videos using conditional random fields

Inferring social relations from visual concepts

Recognize Human Activities from Partially Observed Videos

Efficient Boosted Exemplar-Based Face Detection

Weakly supervised semantic segmentation for social images

Social Role Discovery in Human Events

Mid-level deep pattern mining

Fusing Robust Face Region Descriptors via Multiple Metric Learning for Face Recognition in the Wild

Recognize complex events from static images by fusing deep channels