NDLI: Customer behavior classification using surveillance camera for marketing

Content Provider	Springer Nature Link
Author	Liu, Jingwen Gu, Yanlei Kamijo, Shunsuke
Copyright Year	2016
Abstract	The analysis of customer behavior from surveillance camera is one of the most important open topics for marketing. Traditionally, retailers use the records of cash registers or credit cards to analyze the buying behaviors of customers. However, this information cannot reveal the behaviors of customer when he or she shows interest on the front of the merchandise shelf but does not buy. Those behaviors can be recorded and analyzed by the surveillance camera. We propose a system to classify different customer behaviors on the front of shelf: no interest, viewing, turning body to shelf, touching, picking and returning to shelf and picking and putting into basket, which show customer’s increasing interest to products. In the proposed system, head orientation, body orientation, and arm action, the multiple cues are integrated for the customer behavior recognition. The proposed system discretizes the head and body orientation of customer into 8 directions to estimate whether the customer is looking or turning to the merchandise shelf. Semi-Supervised Learning method is applied to optimize the training dataset and to generate the accurate classifier. In addition, the temporal constraint and the human physical model constraint are considered in joint body and head orientation estimation. As for the arm action recognition, a novel Combined Hand Feature (CHF), which includes hand trajectory, tracking status and the relative position between hand and shopping basket, is proposed to classify different arm actions. The hand tracking is done by an improved particle filter. The CHF is classified by Dynamic Bayesian Network (DBN) to output different types of arm actions. A series of experiments demonstrate effectiveness of the proposed technologies and the performance to the developed system.
Starting Page	6595
Ending Page	6622
Page Count	28
File Format	PDF
ISSN	13807501
Journal	Multimedia Tools and Applications
Volume Number	76
Issue Number	5
e-ISSN	15737721
Language	English
Publisher	Springer US
Publisher Date	2016-02-17
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Surveillance camera Customer behavior Orientation estimation Arm action classification Multimedia Information Systems Computer Communication Networks Data Structures, Cryptology and Information Theory Special Purpose and Application-Based Systems
Content Type	Text
Resource Type	Article
Subject	Computer Networks and Communications Hardware and Architecture Software Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Guest editorial: Advances in multimedia surveillance

Effective multimedia surveillance using a human-centric approach

Orientation judgment for abstract paintings

Bus surveillance: how many and where cameras should be placed

Inference topology of distributed camera networks with multiple cameras

Special Issue: Interactive Multimedia Convergence

Classification algorithms for interactive multimedia services: a review

A camera motion histogram descriptor for video shot classification

Semantic multimedia

Customer behavior classification using surveillance camera for marketing

Similar Documents

Guest editorial: Advances in multimedia surveillance

Effective multimedia surveillance using a human-centric approach

Orientation judgment for abstract paintings

Bus surveillance: how many and where cameras should be placed

Inference topology of distributed camera networks with multiple cameras

Special Issue: Interactive Multimedia Convergence

Classification algorithms for interactive multimedia services: a review

A camera motion histogram descriptor for video shot classification

Semantic multimedia

Customer behavior classification using surveillance camera for marketing