NDLI: Static and Dynamic Hand Gesture Recognition in Depth Data Using Dynamic Time Warping

Content Provider	IEEE Xplore Digital Library
Author	Plouffe, G. Cretu, A.-M.
Copyright Year	1963
Abstract	This paper discusses the development of a natural gesture user interface that tracks and recognizes in real time hand gestures based on depth data collected by a Kinect sensor. The interest space corresponding to the hands is first segmented based on the assumption that the hand of the user is the closest object in the scene to the camera. A novel algorithm is proposed to improve the scanning time in order to identify the first pixel on the hand contour within this space. Starting from this pixel, a directional search algorithm allows for the identification of the entire hand contour. The k-curvature algorithm is then employed to locate the fingertips over the contour, and dynamic time warping is used to select gesture candidates and also to recognize gestures by comparing an observed gesture with a series of prerecorded reference gestures. The comparison of results with state-of-the-art approaches shows that the proposed system outperforms most of the solutions for the static recognition of sign digits and is similar in terms of performance for the static and dynamic recognition of popular signs and for the sign language alphabet. The solution simultaneously deals with static and dynamic gestures as well as with multiple hands within the interest space. An average recognition rate of 92.4% is achieved over 55 static and dynamic gestures. Two possible applications of this work are discussed and evaluated: one for interpretation of sign digits and gestures for a friendlier human-machine interaction and the other one for the natural control of a software interface.
Sponsorship	IEEE Instrumentation and Measurement Society Bureau international des poids et mesures IEEE International Bureau of Weights and Measures (BIPM) URSI NBS Agency Ind. Sci. & Technol., Min. Int. Trade & Ind. Sci. Council Japan International Union of Pure and Applied Physics (IUPAP) NIST NRCC National Conference of Standards Laboratories (NCSL) Allen Osborne Associates Andeen-Hagerling, Inc. Ballantine Lab. Inc. Clarke-Hess Communications Research Corp. Fluke Corporation Guildline Instruments Hewlett-Packard Co. Julie Res. Lab. Inc. Keithley Instruments, Inc. Measurements International Ltd. Canada QuadTech Inc. Quantum Design Inc. Rotek Instrum. Corp. Tegam Inc. Tektronix Inc
Starting Page	305
Ending Page	316
Page Count	12
File Size	3542657
File Format	PDF
ISSN	00189456
Volume Number	65
Issue Number	2
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2016-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Gesture recognition Image color analysis Heuristic algorithms Assistive technology Real-time systems Inspection Cameras static gestures. Dynamic gestures hand gesture recognition human-computer interaction Red Green Blue - Depth (RGB-D) sensor static gestures human–computer interaction
Content Type	Text
Resource Type	Article
Subject	Instrumentation Electrical and Electronic Engineering

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Human-Computer Interaction Based on Hand Gestures Using RGB-D Sensors

A New Approach For Hand Gestures Recognition Based on Depth Map Captured by RGB-D Camera

Contour Model-Based Hand-Gesture Recognition Using the Kinect Sensor

RGB-D static gesture recognition based on convolutional neural network

Gesture Feature Extraction for Static Gesture Recognition

Hand Movements and Gestures Characterization Using Quaternion Dynamic Time Warping Technique

Real-Time Multiple Human Perception With Color-Depth Cameras on a Mobile Robot

A Gesture Recognition System for Detecting Behavioral Patterns of ADHD

Development of gesture-based human–computer interaction applications by fusion of depth and colour video streams

Static and Dynamic Hand Gesture Recognition in Depth Data Using Dynamic Time Warping

Similar Documents

Human-Computer Interaction Based on Hand Gestures Using RGB-D Sensors

A New Approach For Hand Gestures Recognition Based on Depth Map Captured by RGB-D Camera

Contour Model-Based Hand-Gesture Recognition Using the Kinect Sensor

RGB-D static gesture recognition based on convolutional neural network

Gesture Feature Extraction for Static Gesture Recognition

Hand Movements and Gestures Characterization Using Quaternion Dynamic Time Warping Technique

Real-Time Multiple Human Perception With Color-Depth Cameras on a Mobile Robot

A Gesture Recognition System for Detecting Behavioral Patterns of ADHD

Development of gesture-based human–computer interaction applications by fusion of depth and colour video streams

Static and Dynamic Hand Gesture Recognition in Depth Data Using Dynamic Time Warping