NDLI: Depth-based tracking with physical constraints for robot manipulation

Content Provider	IEEE Xplore Digital Library
Author	Schmidt, T. Hertkorn, K. Newcombe, R. Marton, Z. Suppa, M. Fox, D.
Copyright Year	2015
Description	Author affiliation: Dept. of Comput. Sci. & Eng., Univ. of Washington, Seattle, WA, USA (Schmidt, T.; Newcombe, R.; Fox, D.) \|\| Inst. of Robot. & Mechatron., German Aerosp. Center (DLR), Wessling, Germany (Hertkorn, K.; Marton, Z.; Suppa, M.)
Abstract	This work integrates visual and physical constraints to perform real-time depth-only tracking of articulated objects, with a focus on tracking a robot's manipulators and manipulation targets in realistic scenarios. As such, we extend DART, an existing visual articulated object tracker, to additionally avoid interpenetration of multiple interacting objects, and to make use of contact information collected via torque sensors or touch sensors. To achieve greater stability, the tracker uses a switching model to detect when an object is stationary relative to the table or relative to the palm and then uses information from multiple frames to converge to an accurate and stable estimate. Deviation from stable states is detected in order to remain robust to failed grasps and dropped objects. The tracker is integrated into a shared autonomy system in which it provides state estimates used by a grasp planner and the controller of two anthropomorphic hands. We demonstrate the advantages and performance of the tracking system in simulation and on a real robot. Qualitative results are also provided for a number of challenging manipulations that are made possible by the speed, accuracy, and stability of the tracking system.
Starting Page	119
Ending Page	126
File Size	4132051
Page Count	8
File Format	PDF
e-ISBN	9781479969234
DOI	10.1109/ICRA.2015.7138989
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-05-26
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Visualization Joints Robot sensing systems Cameras Calibration
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Depth-Based Tracking with Physical Constraints for Robot Manipulation

Cognitive tracking of surgical instruments based on stereo vision and depth sensing

Robot arm manipulation using depth-sensing cameras and inverse kinematics

Task priority control for aerial manipulation

A position based visual tracking system for a 7 DOF robot manipulator using a Kinect camera

Sensor fusion for model based 3D tracking

Depth-aided robust localization approach for relative navigation using RGB-depth camera and LiDAR sensor

Constraints for Heterogeneous Sensor Auto-Calibration

A Hybrid Neural-PID Control Scheme for Adaptive Visual Tracking

Depth-based tracking with physical constraints for robot manipulation

Similar Documents

Depth-Based Tracking with Physical Constraints for Robot Manipulation

Cognitive tracking of surgical instruments based on stereo vision and depth sensing

Robot arm manipulation using depth-sensing cameras and inverse kinematics

Task priority control for aerial manipulation

A position based visual tracking system for a 7 DOF robot manipulator using a Kinect camera

Sensor fusion for model based 3D tracking

Depth-aided robust localization approach for relative navigation using RGB-depth camera and LiDAR sensor

Constraints for Heterogeneous Sensor Auto-Calibration

A Hybrid Neural-PID Control Scheme for Adaptive Visual Tracking

Depth-based tracking with physical constraints for robot manipulation