NDLI: Spatio-temporal 3D surface matching for hand gesture recognition using ICP algorithm

Content Provider	Springer Nature Link
Author	Nasri, Saeed Behrad, Alireza Razzazi, Farbod
Copyright Year	2013
Abstract	With emerging new applications like virtual reality, different algorithms for human action and gesture recognition have been proposed. In this paper, a new method for the recognition of moving hand gestures is presented. The proposed algorithm is based on the representation of hand motion as spatio-temporal 3D surfaces. Then, 3D surface matching is used to recognize the hand gesture. To form the spatio-temporal 3D surface of hand motion, we first apply the necessary preprocessing to video frames and extract hand contours. Then, by normalizing and overlapping hand contours in different frames, we construct spatio-temporal 3D surface of the hand gesture. To recognize hand gesture, we match the input 3D surface with surfaces in the database. For this purpose, we utilize ICP algorithm to find and compensate for 3D transformation between surfaces as well as the similarity measure between them. In real-world applications, hand motion is continuous and results in a sequence of disjointed hand gestures, which is called continuous hand gesture. To recognize continuous hand gestures, we propose an algorithm which first estimates probable disjointed gestures in the continuous gesture and then divides iteratively continuous gestures to true disjointed gestures. Finally, by applying a robust algorithm, the continuous gesture is recognized. We tested the proposed algorithm with hand gestures of American sign language and results showed the recognition rate of 94 % for disjointed gestures and 93.9 % for continuous gestures. The experimental results showed the efficiency of the proposed algorithm for hand gestures with noise as well.
Starting Page	1205
Ending Page	1220
Page Count	16
File Format	PDF
ISSN	18631703
Journal	Signal, Image and Video Processing
Volume Number	9
Issue Number	5
e-ISSN	18631711
Language	English
Publisher	Springer London
Publisher Date	2013-10-13
Publisher Place	London
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Gesture recognition Hand gestures Continuous gesture recognition 3D surface matching ICP (Iterative Closest Points) algorithm Signal, Image and Speech Processing Image Processing and Computer Vision Computer Imaging, Vision, Pattern Recognition and Graphics Multimedia Information Systems
Content Type	Text
Resource Type	Article
Subject	Signal Processing Electrical and Electronic Engineering

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A HCI interface based on hand gestures

Real-time robust vision-based hand gesture recognition using stereo images

On an algorithm for Vision-based hand gesture recognition

Viewpoint-independent hand gesture recognition with Kinect

Comparison of shape descriptors for hand posture recognition in video

LSTM-based dynamic probability continuous hand gesture trajectory recognition

HandVR: a hand-gesture-based interface to a video retrieval system

Parallel implementation of a spatio-temporal visual saliency model

Novel Haar features for real-time hand gesture recognition using SVM

Spatio-temporal 3D surface matching for hand gesture recognition using ICP algorithm

Similar Documents

A HCI interface based on hand gestures

Real-time robust vision-based hand gesture recognition using stereo images

On an algorithm for Vision-based hand gesture recognition

Viewpoint-independent hand gesture recognition with Kinect

Comparison of shape descriptors for hand posture recognition in video

LSTM-based dynamic probability continuous hand gesture trajectory recognition

HandVR: a hand-gesture-based interface to a video retrieval system

Parallel implementation of a spatio-temporal visual saliency model

Novel Haar features for real-time hand gesture recognition using SVM

Spatio-temporal 3D surface matching for hand gesture recognition using ICP algorithm