NDLI: Rate-Constrained 3D Surface Estimation From Noise-Corrupted Multiview Depth Videos

Content Provider	IEEE Xplore Digital Library
Author	Wenxiu Sun Cheung, G. Chou, P.A. Florencio, D. Cha Zhang Au, O.C.
Copyright Year	1992
Abstract	Transmitting compactly represented geometry of a dynamic 3D scene from a sender can enable a multitude of imaging functionalities at a receiver, such as synthesis of virtual images at freely chosen viewpoints via depth-image-based rendering. While depth maps-projections of 3D geometry onto 2D image planes at chosen camera viewpoints-can nowadays be readily captured by inexpensive depth sensors, they are often corrupted by non-negligible acquisition noise. Given depth maps need to be denoised and compressed at the encoder for efficient network transmission to the decoder, in this paper, we consider the denoising and compression problems jointly, arguing that doing so will result in a better overall performance than the alternative of solving the two problems separately in two stages. Specifically, we formulate a rate-constrained estimation problem, where given a set of observed noise-corrupted depth maps, the most probable (maximum a posteriori (MAP)) 3D surface is sought within a search space of surfaces with representation size no larger than a prespecified rate constraint. Our rate-constrained MAP solution reduces to the conventional unconstrained MAP 3D surface reconstruction solution if the rate constraint is loose. To solve our posed rate-constrained estimation problem, we propose an iterative algorithm, where in each iteration the structure (object boundaries) and the texture (surfaces within the object boundaries) of the depth maps are optimized alternately. Using the MVC codec for compression of multiview depth video and MPEG free viewpoint video sequences as input, experimental results show that rate-constrained estimated 3D surfaces computed by our algorithm can reduce coding rate of depth maps by up to 32% compared with unconstrained estimated surfaces for the same quality of synthesized virtual views at the decoder.
Sponsorship	IEEE Signal Processing Society
Page Count	14
File Size	3290124
Starting Page	3138
Ending Page	3151
File Format	PDF
ISSN	10577149
Volume Number	23
Issue Number	7
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Three-dimensional displays Surface reconstruction Image coding Cameras Surface treatment Estimation Noise depth image compression Multiview video image denoising
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Temporal Subsampling Approach for Multiview Depth Map Compression

Multiview Image Coding Using Depth Layers and an Optimized Bit Allocation

Efficient Multiview Depth Coding Optimization Based on Allowable Depth Distortion in View Synthesis

Temporally consistent depth map estimation for 3D video generation and coding

Panorama View With Spatiotemporal Occlusion Compensation for 3D Video Coding

Object based coding of the depth maps for 3D video coding

Graph-Based Representation for Multiview Image Geometry

Multirate 3-D subband coding of video

Multiview Plus Depth Video Coding With Temporal Prediction View Synthesis

Rate-Constrained 3D Surface Estimation From Noise-Corrupted Multiview Depth Videos

Similar Documents

A Temporal Subsampling Approach for Multiview Depth Map Compression

Multiview Image Coding Using Depth Layers and an Optimized Bit Allocation

Efficient Multiview Depth Coding Optimization Based on Allowable Depth Distortion in View Synthesis

Temporally consistent depth map estimation for 3D video generation and coding

Panorama View With Spatiotemporal Occlusion Compensation for 3D Video Coding

Object based coding of the depth maps for 3D video coding

Graph-Based Representation for Multiview Image Geometry

Multirate 3-D subband coding of video

Multiview Plus Depth Video Coding With Temporal Prediction View Synthesis

Rate-Constrained 3D Surface Estimation From Noise-Corrupted Multiview Depth Videos