NDLI: A Spatiotemporal Saliency Model for Video Surveillance

Content Provider	Springer Nature Link
Author	Yubing, Tong Cheikh, Faouzi Alaya Guraya, Fahad Fazal Elahi Konik, Hubert Trémeau, Alain
Copyright Year	2011
Abstract	A video sequence is more than a sequence of still images. It contains a strong spatial–temporal correlation between the regions of consecutive frames. The most important characteristic of videos is the perceived motion foreground objects across the frames. The motion of foreground objects dramatically changes the importance of the objects in a scene and leads to a different saliency map of the frame representing the scene. This makes the saliency analysis of videos much more complicated than that of still images. In this paper, we investigate saliency in video sequences and propose a novel spatiotemporal saliency model devoted for video surveillance applications. Compared to classical saliency models based on still images, such as Itti’s model, and space–time saliency models, the proposed model is more correlated to visual saliency perception of surveillance videos. Both bottom-up and top-down attention mechanisms are involved in this model. Stationary saliency and motion saliency are, respectively, analyzed. First, a new method for background subtraction and foreground extraction is developed based on content analysis of the scene in the domain of video surveillance. Then, a stationary saliency model is setup based on multiple features computed from the foreground. Every feature is analyzed with a multi-scale Gaussian pyramid, and all the features conspicuity maps are combined using different weights. The stationary model integrates faces as a supplement feature to other low level features such as color, intensity and orientation. Second, a motion saliency map is calculated using the statistics of the motion vectors field. Third, both motion saliency map and stationary saliency map are merged based on center-surround framework defined by an approximated Gaussian function. The video saliency maps computed from our model have been compared to the gaze maps obtained from subjective experiments with SMI eye tracker for surveillance video sequences. The results show strong correlation between the output of the proposed spatiotemporal saliency model and the experimental gaze maps.
Starting Page	241
Ending Page	263
Page Count	23
File Format	PDF
ISSN	18669956
Journal	Cognitive Computation
Volume Number	3
Issue Number	1
e-ISSN	18669964
Language	English
Publisher	Springer-Verlag
Publisher Date	2011-01-08
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Visual saliency Motion saliency Background subtraction Center-surround saliency Face detection Video surveillance Neurosciences Artificial Intelligence (incl. Robotics) Computational Biology/Bioinformatics Computation by Abstract Devices
Content Type	Text
Resource Type	Article
Subject	Cognitive Neuroscience Computer Science Applications Computer Vision and Pattern Recognition

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Improving Visual Saliency by Adding ‘Face Feature Map’ and ‘Center Bias’

Spatiotemporal Features for Action Recognition and Salient Event Detection

Region-Based Artificial Visual Attention in Space and Time

A New Spatio-Temporal Saliency-Based Video Object Segmentation

Spatiotemporal Saliency in Dynamic Scenes

Saliency, Attention, Active Visual Search, and Picture Scanning

Background-Subtraction in Thermal Imagery Using Contour Saliency

Erratum to: A New Spatio-Temporal Saliency-Based Video Object Segmentation

A Novel Biologically Inspired Visual Saliency Model

A Spatiotemporal Saliency Model for Video Surveillance

Similar Documents

Improving Visual Saliency by Adding ‘Face Feature Map’ and ‘Center Bias’

Spatiotemporal Features for Action Recognition and Salient Event Detection

Region-Based Artificial Visual Attention in Space and Time

A New Spatio-Temporal Saliency-Based Video Object Segmentation

Spatiotemporal Saliency in Dynamic Scenes

Saliency, Attention, Active Visual Search, and Picture Scanning

Background-Subtraction in Thermal Imagery Using Contour Saliency

Erratum to: A New Spatio-Temporal Saliency-Based Video Object Segmentation

A Novel Biologically Inspired Visual Saliency Model

A Spatiotemporal Saliency Model for Video Surveillance