NDLI: Learning-Based, Automatic 2D-to-3D Image and Video Conversion

Content Provider	IEEE Xplore Digital Library
Author	Konrad, J. Meng Wang Ishwar, P. Chen Wu Mukherjee, D.
Copyright Year	1992
Abstract	Despite a significant growth in the last few years, the availability of 3D content is still dwarfed by that of its 2D counterpart. To close this gap, many 2D-to-3D image and video conversion methods have been proposed. Methods involving human operators have been most successful but also time-consuming and costly. Automatic methods, which typically make use of a deterministic 3D scene model, have not yet achieved the same level of quality for they rely on assumptions that are often violated in practice. In this paper, we propose a new class of methods that are based on the radically different approach of learning the 2D-to-3D conversion from examples. We develop two types of methods. The first is based on learning a point mapping from local image/video attributes, such as color, spatial position, and, in the case of video, motion at each pixel, to scene-depth at that pixel using a regression type idea. The second method is based on globally estimating the entire depth map of a query image directly from a repository of 3D images ( image+depth pairs or stereopairs) using a nearest-neighbor regression type idea. We demonstrate both the efficacy and the computational efficiency of our methods on numerous 2D images and discuss their drawbacks and benefits. Although far from perfect, our results demonstrate that repositories of 3D content can be used for effective 2D-to-3D image conversion. An extension to video is immediate by enforcing temporal continuity of computed depth maps.
Sponsorship	IEEE Signal Processing Society
Page Count	12
File Size	1980660
Starting Page	3485
Ending Page	3496
File Format	PDF
ISSN	10577149
Volume Number	22
Issue Number	9
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	cross-bilateral filtering 3D images stereoscopic images image conversion nearest neighbor classification
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Steganographic data hiding in automatic converted 3D image from 2D and 2D to 3D video conversion

Example-based super-resolution

Hierarchical Representations of 2D/3D Gray-Scale Images and Their 2D/3D Two-Way Conversion

An efficient approach for 2D to 3D video conversion based on structure from motion

Adaptive Image Warping for Hole Prevention in 3D View Synthesis

Minimizing user intervention in registering 2D images to 3D models

Enabling warping on stereoscopic images

Robust detection of skew in document images

Saliency Detection for Stereoscopic Images

Learning-Based, Automatic 2D-to-3D Image and Video Conversion

Similar Documents

Steganographic data hiding in automatic converted 3D image from 2D and 2D to 3D video conversion

Example-based super-resolution

Hierarchical Representations of 2D/3D Gray-Scale Images and Their 2D/3D Two-Way Conversion

An efficient approach for 2D to 3D video conversion based on structure from motion

Adaptive Image Warping for Hole Prevention in 3D View Synthesis

Minimizing user intervention in registering 2D images to 3D models

Enabling warping on stereoscopic images

Robust detection of skew in document images

Saliency Detection for Stereoscopic Images

Learning-Based, Automatic 2D-to-3D Image and Video Conversion