NDLI: Real-time surface light-field capture for augmentation of planar specular surfaces

Content Provider	IEEE Xplore Digital Library
Author	Jachnik, J. Newcombe, R.A. Davison, A.J.
Copyright Year	2012
Description	Author affiliation: Imperial College London, UK (Jachnik, J.; Newcombe, R.A.; Davison, A.J.)
Abstract	A single hand-held camera provides an easily accessible but potentially extremely powerful setup for augmented reality. Capabilities which previously required expensive and complicated infrastructure have gradually become possible from a live monocular video feed, such as accurate camera tracking and, most recently, dense 3D scene reconstruction. A new frontier is to work towards recovering the reflectance properties of general surfaces and the lighting configuration in a scene without the need for probes, omni-directional cameras or specialised light-field cameras. Specular lighting phenomena cause effects in a video stream which can lead current tracking and reconstruction algorithms to fail. However, the potential exists to measure and use these effects to estimate deeper physical details about an environment, enabling advanced scene understanding and more convincing AR. In this paper we present an algorithm for real-time surface light-field capture from a single hand-held camera, which is able to capture dense illumination information for general specular surfaces. Our system incorporates a guidance mechanism to help the user interactively during capture. We then split the light-field into its diffuse and specular components, and show that the specular component can be used for estimation of an environment map. This enables the convincing placement of an augmentation on a specular surface such as a shiny book, with realistic synthesized shadow, reflection and occlusion of specularities as the viewpoint changes. Our method currently works for planar scenes, but the surface light-field representation makes it ideal for future combination with dense 3D reconstruction methods.
Starting Page	91
Ending Page	97
File Size	6783631
Page Count	7
File Format	PDF
ISBN	9781467346603
e-ISBN	9781467346627
e-ISBN	9781467346610
DOI	10.1109/ISMAR.2012.6402544
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-11-05
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Cameras Lighting Real-time systems Surface treatment Image color analysis Surface texture Light sources AR Real-Time Light-Fields Illumination Estimation GPU SLAM
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Real-time surface light-field capture for augmentation of planar specular surfaces.

Reflectance and light source estimation for indoor AR Applications

High-speed stroboscope for specular reflection removal of DC illumination

Estimation of multiple light sources from specular highlights

Virtualizing real objects with surface interreflections

Illumination Invariant Measuring of Skin Pigmentation

Image-based separation of diffuse and specular reflections using environmental structured illumination

Linear Estimation of 4-D Illumination Light Field from Diffuse Reflections

Illumination Estimation Based Color Contrast Enhancement

Real-time surface light-field capture for augmentation of planar specular surfaces

Similar Documents

Real-time surface light-field capture for augmentation of planar specular surfaces.

Reflectance and light source estimation for indoor AR Applications

High-speed stroboscope for specular reflection removal of DC illumination

Estimation of multiple light sources from specular highlights

Virtualizing real objects with surface interreflections

Illumination Invariant Measuring of Skin Pigmentation

Image-based separation of diffuse and specular reflections using environmental structured illumination

Linear Estimation of 4-D Illumination Light Field from Diffuse Reflections

Illumination Estimation Based Color Contrast Enhancement

Real-time surface light-field capture for augmentation of planar specular surfaces