NDLI: A Consensus-Driven Approach for Structure and Texture Aware Depth Map Upsampling

Content Provider	IEEE Xplore Digital Library
Author	Ouk Choi Seung-Won Jung
Copyright Year	1992
Abstract	This paper presents a method for increasing spatial resolution of a depth map using its corresponding high-resolution (HR) color image as a guide. Most of the previous methods rely on the assumption that depth discontinuities are highly correlated with color boundaries, leading to artifacts in the regions where the assumption is broken. To prevent scene texture from being erroneously transferred to reconstructed scene surfaces, we propose a framework for dividing the color image into different regions and applying different methods tailored to each region type. For the region classification, we first segment the low-resolution (LR) depth map into regions of smooth surfaces, and then use them to guide the segmentation of the color image. Using the consensus of multiple image segmentations obtained by different super-pixel generation methods, the color image is divided into continuous and discontinuous regions: in the continuous regions, their HR depth values are interpolated from LR depth samples without exploiting the color information. In the discontinuous regions, their HR depth values are estimated by sequentially applying more complicated depth-histogram-based methods. Through experiments, we show that each step of our method improves depth map upsampling both quantitatively and qualitatively. We also show that our method can be extended to handle real data with occluded regions caused by the displacement between color and depth sensors.
Sponsorship	IEEE Signal Processing Society
Page Count	15
File Size	4106205
Starting Page	3321
Ending Page	3335
File Format	PDF
ISSN	10577149
Volume Number	23
Issue Number	8
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Image color analysis Color Image segmentation Spatial resolution Sensors Licenses Cameras stereo reconstruction Depth estimation depth map upsampling
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

High-Quality Depth Map Upsampling and Completion for RGB-D Cameras

Depth map upsampling with image decomposition

Accurate Multiple View 3D Reconstruction Using Patch-Based Stereo for Large-Scale Scenes

Stereo Matching Using Epipolar Distance Transform

Efficient Hybrid Tree-Based Stereo Matching With Applications to Postcapture Image Refocusing

Multifocusing and Depth Estimation Using a Color Shift Model-Based Computational Camera

A MAP Approach for Joint Motion Estimation, Segmentation, and Super Resolution

A Weighted Optimization Approach to Time-of-Flight Sensor Fusion

High Resolution Local Structure-Constrained Image Upsampling

A Consensus-Driven Approach for Structure and Texture Aware Depth Map Upsampling

Similar Documents

High-Quality Depth Map Upsampling and Completion for RGB-D Cameras

Depth map upsampling with image decomposition

Accurate Multiple View 3D Reconstruction Using Patch-Based Stereo for Large-Scale Scenes

Stereo Matching Using Epipolar Distance Transform

Efficient Hybrid Tree-Based Stereo Matching With Applications to Postcapture Image Refocusing

Multifocusing and Depth Estimation Using a Color Shift Model-Based Computational Camera

A MAP Approach for Joint Motion Estimation, Segmentation, and Super Resolution

A Weighted Optimization Approach to Time-of-Flight Sensor Fusion

High Resolution Local Structure-Constrained Image Upsampling

A Consensus-Driven Approach for Structure and Texture Aware Depth Map Upsampling