NDLI: Multifocusing and Depth Estimation Using a Color Shift Model-Based Computational Camera

Content Provider	IEEE Xplore Digital Library
Author	Kim, S. Lee, E. Hayes, M. H. Paik, J.
Copyright Year	1992
Abstract	This paper presents a novel approach to depth estimation using a multiple color-filter aperture (MCA) camera and its application to multifocusing. An image acquired by the MCA camera contains spatially varying misalignment among RGB color channels, where the direction and length of the misalignment is a function of the distance of an object from the plane of focus. Therefore, if the misalignment is estimated from the MCA output image, multifocusing and depth estimation become possible using a set of image processing algorithms. We first segment the image into multiple clusters having approximately uniform misalignment using a color-based region classification method, and then find a rectangular region that encloses each cluster. For each of the rectangular regions in the RGB color channels, color shifting vectors are estimated using a phase correlation method. After the set of three clusters are aligned in the opposite direction of the estimated color shifting vectors, the aligned clusters are fused to produce an approximately in-focus image. Because of the finite size of the color-filter apertures, the fused image still contains a certain amount of spatially varying out-of-focus blur, which is removed by using a truncated constrained least-squares filter followed by a spatially adaptive artifacts removing filter. Experimental results show that the MCA-based multifocusing method significantly enhances the visual quality of an image containing multiple objects of different distances, and can be fully or partially incorporated into multifocusing or extended depth of field systems. The MCA camera also realizes single camera-based depth estimation, where the displacement between multiple apertures plays a role of the baseline of a stereo vision system. Experimental results show that the estimated depth is accurate enough to perform a variety of vision-based tasks, such as image understanding, description, and robot vision.
Sponsorship	IEEE Signal Processing Society
Page Count	15
File Size	5453139
Starting Page	4152
Ending Page	4166
File Format	PDF
ISSN	10577149
Volume Number	21
Issue Number	9
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-09-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Image color analysis Cameras Apertures Estimation Optical sensors Image segmentation Lenses multifocusing Color shifting vector computational camera depth estimation
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Using Focused Plenoptic Cameras for Rich Image Capture

Single camera-based full depth map estimation using color shifting property of a multiple color-filter aperture

Single image-based depth estimation using dual off-axis color filtered aperture camera

A Consensus-Driven Approach for Structure and Texture Aware Depth Map Upsampling

Camera Processing With Chromatic Aberration

Color-Guided Depth Recovery From RGB-D Data Using an Adaptive Autoregressive Model

Extracting depth and matte using a color-filtered aperture

Simultaneous object tracking and depth estimation using color shifting property of a multiple color-filter aperture camera

Efficient Hybrid Tree-Based Stereo Matching With Applications to Postcapture Image Refocusing

Multifocusing and Depth Estimation Using a Color Shift Model-Based Computational Camera

Similar Documents

Using Focused Plenoptic Cameras for Rich Image Capture

Single camera-based full depth map estimation using color shifting property of a multiple color-filter aperture

Single image-based depth estimation using dual off-axis color filtered aperture camera

A Consensus-Driven Approach for Structure and Texture Aware Depth Map Upsampling

Camera Processing With Chromatic Aberration

Color-Guided Depth Recovery From RGB-D Data Using an Adaptive Autoregressive Model

Extracting depth and matte using a color-filtered aperture

Simultaneous object tracking and depth estimation using color shifting property of a multiple color-filter aperture camera

Efficient Hybrid Tree-Based Stereo Matching With Applications to Postcapture Image Refocusing

Multifocusing and Depth Estimation Using a Color Shift Model-Based Computational Camera