NDLI: Transparent object detection and reconstruction on a mobile platform

Content Provider	IEEE Xplore Digital Library
Author	Klank, U. Carton, D. Beetz, M.
Copyright Year	2011
Description	Author affiliation: Intelligent Autonomous Systems, Technische Universität München, Boltzmannstr. 3, Garching bei München, 85748, Germany (Klank, U.; Carton, D.; Beetz, M.)
Abstract	In this paper we propose a novel approach to detect and reconstruct transparent objects. This approach makes use of the fact that many transparent objects, especially the ones consisting of usual glass, absorb light in certain wavelengths [1]. Given a controlled illumination, this absorption is measurable in the intensity response by comparison to the background. We show the usage of a standard infrared emitter and the intensity sensor of a time of flight (ToF) camera to reconstruct the structure given we have a second view point. The structure can not be measured by the usual 3D measurements of the ToF camera. We take advantage of this fact by deriving this internal sensory contradiction from two ToF images and reconstruct an approximated surface of the original transparent object. Therefor we are using a perspectively invariant matching in the intensity channels from the first to the second view of initially acquired candidates. For each matched pixel in the first view a 3D movement can be predicted given their original 3D measurement and the known distance to the second camera position. If their line of sight did not pass a transparent object or suffered any other major defect, this prediction will highly correspond to the actual measured 3D points of the second view. Otherwise, if a detectable error occurs, we approximate a more exact point to point matching and reconstruct the original shape by triangulating the points in the stereo setup. We tested our approach using a mobile platform with one Swissranger SR4k. As this platform is mobile, we were able to create a stereo setup by moving it. Our results show a detection of transparent objects on tables while simultaneously identifying opaque objects that also existed in the test setup. The viability of our results is demonstrated by a successful automated manipulation of the respective transparent object.
Starting Page	5971
Ending Page	5978
File Size	2868793
Page Count	8
File Format	PDF
ISBN	9781612843865
ISSN	10504729
e-ISBN	9781612843858
DOI	10.1109/ICRA.2011.5979793
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2011-05-09
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Three dimensional displays Robot sensing systems Cameras Image reconstruction Image segmentation Robustness
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence Control and Systems Engineering Electrical and Electronic Engineering Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Line-based extrinsic calibration of range and image sensors

Automated doorway detection for assistive shared-control wheelchairs

Urban 3D semantic modelling using stereo vision

Homography-based ground plane detection for mobile robot navigation using a Modified EM algorithm

Unsupervised learning of object affordances for planning in a mobile manipulation platform

Large-baseline matching and reconstruction from symmetry cells

Pose estimation of rigid transparent objects in transparent clutter

Fast and bottom-up object detection, segmentation, and evaluation using Gestalt principles

A large-scale hierarchical multi-view RGB-D object dataset

Transparent object detection and reconstruction on a mobile platform

Similar Documents

Line-based extrinsic calibration of range and image sensors

Automated doorway detection for assistive shared-control wheelchairs

Urban 3D semantic modelling using stereo vision

Homography-based ground plane detection for mobile robot navigation using a Modified EM algorithm

Unsupervised learning of object affordances for planning in a mobile manipulation platform

Large-baseline matching and reconstruction from symmetry cells

Pose estimation of rigid transparent objects in transparent clutter

Fast and bottom-up object detection, segmentation, and evaluation using Gestalt principles

A large-scale hierarchical multi-view RGB-D object dataset

Transparent object detection and reconstruction on a mobile platform