NDLI: 3DNN: 3D Nearest Neighbor : Data-Driven Geometric Scene Understanding Using 3D Models

Content Provider	Springer Nature Link
Author	Satkin, Scott Rashid, Maheen Lin, Jason Hebert, Martial
Copyright Year	2014
Abstract	In this paper, we describe a data-driven approach to leverage repositories of 3D models for scene understanding. Our ability to relate what we see in an image to a large collection of 3D models allows us to transfer information from these models, creating a rich understanding of the scene. We develop a framework for auto-calibrating a camera, rendering 3D models from the viewpoint an image was taken, and computing a similarity measure between each 3D model and an input image. We demonstrate this data-driven approach in the context of geometry estimation and show the ability to find the identities, poses and styles of objects in a scene. The true benefit of 3DNN compared to a traditional 2D nearest-neighbor approach is that by generalizing across viewpoints, we free ourselves from the need to have training examples captured from all possible viewpoints. Thus, we are able to achieve comparable results using orders of magnitude less data, and recognize objects from never-before-seen viewpoints. In this work, we describe the 3DNN algorithm and rigorously evaluate its performance for the tasks of geometry estimation and object detection/segmentation, as well as two novel applications: affordance estimation and photorealistic object insertion.
Starting Page	69
Ending Page	97
Page Count	29
File Format	PDF
ISSN	09205691
Journal	International Journal of Computer Vision
Volume Number	111
Issue Number	1
e-ISSN	15731405
Language	English
Publisher	Springer US
Publisher Date	2014-07-22
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Computer vision Machine learning Scene understanding Geometry estimation 3D data Computer Imaging, Vision, Pattern Recognition and Graphics Artificial Intelligence (incl. Robotics) Image Processing and Computer Vision Pattern Recognition
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Indoor Scene Understanding with Geometric and Semantic Contexts

Geometric Image Parsing in Man-Made Environments

Labeling Complete Surfaces in Scene Understanding

Estimating the Natural Illumination Conditions from a Single Outdoor Image

Towards Scene Understanding with Detailed 3D Object Representations

3D Scene Flow Estimation with a Piecewise Rigid Scene Model

Putting Objects in Perspective

Object Detection using Geometrical Context Feedback

Stereoscopic Scene Flow Computation for 3D Motion Understanding

3DNN: 3D Nearest Neighbor : Data-Driven Geometric Scene Understanding Using 3D Models

Similar Documents

Indoor Scene Understanding with Geometric and Semantic Contexts

Geometric Image Parsing in Man-Made Environments

Labeling Complete Surfaces in Scene Understanding

Estimating the Natural Illumination Conditions from a Single Outdoor Image

Towards Scene Understanding with Detailed 3D Object Representations

3D Scene Flow Estimation with a Piecewise Rigid Scene Model

Putting Objects in Perspective

Object Detection using Geometrical Context Feedback

Stereoscopic Scene Flow Computation for 3D Motion Understanding

3DNN: 3D Nearest Neighbor : Data-Driven Geometric Scene Understanding Using 3D Models