NDLI: Development of gesture-based human–computer interaction applications by fusion of depth and colour video streams

Content Provider	IET Digital Library
Author	Dondi, Piercarlo Lombardi, Luca Porta, Marco
Abstract	Hand detection and gesture recognition are two of the most studied topics in human–computer interaction (HCI). The increasing availability of sensors able to provide real-time depth measurements, such as time-of-flight cameras or the more recent Kinect, has helped researchers to find more and more efficient solutions for these issues. With the main aim to implement effective gesture-based interaction systems, this study presents an approach to hand detection and tracking that exploits two different video streams: the depth one and the colour one. Both hand and gesture recognition are based only on geometrical and colour constraints, and no learning phase is needed. The use of a Kalman filter to track hands guarantees system robustness also in presence of many persons in the scene. The entire procedure is designed to maintain a low computational cost and is optimised to efficiently execute HCI tasks. As use cases two common applications are described: a virtual keyboard and a three-dimensional object manipulation virtual environment. These applications have been tested with a representative sample of non-trained users to assess the usability and flexibility of the system.
Starting Page	568
Ending Page	578
Page Count	11
ISSN	17519632
Volume Number	8
e-ISSN	17519640
Issue Number	Issue 6, Dec (2014)
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/iet-cvi/8/6
Alternate Webpage(s)	https://digital-library.theiet.org/content/journals/10.1049/iet-cvi.2013.0323
Journal	IET Computer Vision
Publisher Date	2014-03-07
Access Restriction	Open
Rights Holder	© The Institution of Engineering and Technology
Subject Keyword	Colour Constraint Colour Video Stream Fusion Computer Vision And Image Processing Technique Depth Fusion Filtering Method in Signal Processing Geometrical Constraint Gesture Recognition Gesture-based Human-computer Interaction System Hand Detection Hand Tracking HCI Task Human Computer Interaction Image Colour Analysis Image Fusion Image Recognition Kalman Filter Kinect Sensor Low Computational Cost Object Tracking Palmprint Recognition Real-time Depth Measurement Sensor Fusion Three-dimensional Object Manipulation Virtual Environment Time-of-flight Cameras User InterFace Video Signal Processing Video Streaming Virtual Keyboard
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Multiple human tracking in RGB-depth data: a survey

Human interaction recognition fusing multiple features of depth sequences

Mechanical arm teleoperation control system by dynamic hand gesture recognition based on kinect device

Gesture recognition algorithm based on multi-scale feature fusion in RGB-D images

A HCI interface based on hand gestures

Static gesture segmentation technique based on improved Sobel operator

Superpixel-Based Hand Gesture Recognition With Kinect Depth Camera

Depth data and fusion of feature descriptors for static gesture recognition

Contour Model-Based Hand-Gesture Recognition Using the Kinect Sensor

Development of gesture-based human–computer interaction applications by fusion of depth and colour video streams

Similar Documents

Multiple human tracking in RGB-depth data: a survey

Human interaction recognition fusing multiple features of depth sequences

Mechanical arm teleoperation control system by dynamic hand gesture recognition based on kinect device

Gesture recognition algorithm based on multi-scale feature fusion in RGB-D images

A HCI interface based on hand gestures

Static gesture segmentation technique based on improved Sobel operator

Superpixel-Based Hand Gesture Recognition With Kinect Depth Camera

Depth data and fusion of feature descriptors for static gesture recognition

Contour Model-Based Hand-Gesture Recognition Using the Kinect Sensor

Development of gesture-based human–computer interaction applications by fusion of depth and colour video streams