NDLI: 2D-3D fusion for layer decomposition of urban facades

Content Provider	IEEE Xplore Digital Library
Author	Yangyan Li Qian Zheng Sharf, A. Cohen-Or, D. Baoquan Chen Mitra, N.J.
Copyright Year	2011
Description	Author affiliation: SIAT, China (Yangyan Li; Qian Zheng; Baoquan Chen) \|\| UCL, China (Mitra, N.J.) \|\| Ben-Gurion Univ., China (Sharf, A.) \|\| Tel Aviv Univ., China (Cohen-Or, D.)
Abstract	We present a method for fusing two acquisition modes, 2D photographs and 3D LiDAR scans, for depth-layer decomposition of urban facades. The two modes have complementary characteristics: point cloud scans are coherent and inherently 3D, but are often sparse, noisy, and incomplete; photographs, on the other hand, are of high resolution, easy to acquire, and dense, but view-dependent and inherently 2D, lacking critical depth information. In this paper we use photographs to enhance the acquired LiDAR data. Our key observation is that with an initial registration of the 2D and 3D datasets we can decompose the input photographs into rectified depth layers. We decompose the input photographs into rectangular planar fragments and diffuse depth information from the corresponding 3D scan onto the fragments by solving a multi-label assignment problem. Our layer decomposition enables accurate repetition detection in each planar layer, using which we propagate geometry, remove outliers and enhance the 3D scan. Finally, the algorithm produces an enhanced, layered, textured model. We evaluate our algorithm on complex multi-planar building facades, where direct autocorrelation methods for repetition detection fail. We demonstrate how 2D photographs help improve the 3D scans by exploiting data redundancy, and transferring high level structural information to (plausibly) complete large missing regions.
Starting Page	882
Ending Page	889
File Size	3624858
Page Count	8
File Format	PDF
ISBN	9781457711015
ISSN	15505499
e-ISBN	9781457711022
DOI	10.1109/ICCV.2011.6126329
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2011-11-06
Publisher Place	Spain
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Three dimensional displays Buildings Image edge detection Solid modeling Image segmentation Laser radar Geometry
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Component Identification in the 3D Model of a Building

Orientation descriptors for localization in urban environments

3D Building Detection and Modeling from Aerial LIDAR Data

Beat the MTurkers: Automatic Image Labeling from Weak 3D Supervision

Inferring 3D layout of building facades from a single image

Sampling bedrooms

3DNN: Viewpoint Invariant 3D Geometry Matching for Scene Understanding

Alignment of continuous video onto 3D point clouds

Co-segmentation of Textured 3D Shapes with Sparse Annotations

2D-3D fusion for layer decomposition of urban facades

Similar Documents

Component Identification in the 3D Model of a Building

Orientation descriptors for localization in urban environments

3D Building Detection and Modeling from Aerial LIDAR Data

Beat the MTurkers: Automatic Image Labeling from Weak 3D Supervision

Inferring 3D layout of building facades from a single image

Sampling bedrooms

3DNN: Viewpoint Invariant 3D Geometry Matching for Scene Understanding

Alignment of continuous video onto 3D point clouds

Co-segmentation of Textured 3D Shapes with Sparse Annotations

2D-3D fusion for layer decomposition of urban facades