NDLI: FollowMe: Person following and gesture recognition with a quadrocopter

Content Provider	IEEE Xplore Digital Library
Author	Naseer, T. Sturm, J. Cremers, D.
Copyright Year	2013
Description	Author affiliation: Dept. of Comput. Sci., Tech. Univ. of Munich, Munich, Germany (Sturm, J.; Cremers, D.) \|\| Dept. of Comput. Sci., Univ. of Freiburg, Freiburg, Germany (Naseer, T.)
Abstract	In this paper, we present an approach that allows a quadrocopter to follow a person and to recognize simple gestures using an onboard depth camera. This enables novel applications such as hands-free filming and picture taking. The problem of tracking a person with an onboard camera however is highly challenging due to the self-motion of the platform. To overcome this problem, we stabilize the depth image by warping it to a virtual-static camera, using the estimated pose of the quadrocopter obtained from vision and inertial sensors using an Extended Kalman filter. We show that such a stabilized depth video is well suited to use with existing person trackers such as the OpenNI tracker. Using this approach, the quadrocopter not only obtains the position and orientation of the tracked person, but also the full body pose - which can then for example be used to recognize hand gestures to control the quadrocopter's behaviour. We implemented a small set of example commands (“follow me”, “take picture”, “land”), and generate corresponding motion commands. We demonstrate the practical performance of our approach in an extensive set of experiments with a quadrocopter. Although our current system is limited to indoor environments and small motions due to the restrictions of the used depth sensor, it indicates that there is large potential for such applications in the near future.
Sponsorship	IEEE Ind. Electron. Soc.
Starting Page	624
Ending Page	630
File Size	1797933
Page Count	7
File Format	PDF
ISSN	21530858
DOI	10.1109/IROS.2013.6696416
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-11-03
Publisher Place	Japan
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Cameras Robot vision systems Three-dimensional displays Tracking Visualization Trajectory
Content Type	Text
Resource Type	Article
Subject	Control and Systems Engineering Computer Science Applications Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Partial visibility constraint in 3D visual servoing

Pipe mapping with monocular fisheye imagery

Enhancing visual perception of shape through tactile glances

Posture recognition with a top-view camera

Uncalibrated 3D stereo image-based dynamic visual servoing for robot manipulators

An expected perception architecture using visual 3D reconstruction for a humanoid robot

Enhancing 6D visual relocalisation with depth cameras

Bi-manual robotic paper manipulation based on real-time marker tracking and physical modelling

Camera localization using mutual information-based multiplane tracking

FollowMe: Person following and gesture recognition with a quadrocopter

Similar Documents

Partial visibility constraint in 3D visual servoing

Pipe mapping with monocular fisheye imagery

Enhancing visual perception of shape through tactile glances

Posture recognition with a top-view camera

Uncalibrated 3D stereo image-based dynamic visual servoing for robot manipulators

An expected perception architecture using visual 3D reconstruction for a humanoid robot

Enhancing 6D visual relocalisation with depth cameras

Bi-manual robotic paper manipulation based on real-time marker tracking and physical modelling

Camera localization using mutual information-based multiplane tracking

FollowMe: Person following and gesture recognition with a quadrocopter