NDLI: CrossLink: joint understanding of image and 3D model collections through shape and camera pose variations

Content Provider	ACM Digital Library
Author	Ovsjanikov, Maks Mitra, Niloy J. Hueting, Moos
Copyright Year	2015
Abstract	Collections of images and 3D models hide in them many interesting aspects of our surroundings. Significant efforts have been devoted to organize and explore such data repositories. Most such efforts, however, process the two data modalities separately, and do not take full advantage of the complementary information that exist in different domains, which can help to solve difficult problems in one by exploiting the structure in the other. Beyond the obvious difference in data representations, a key difficulty in such joint analysis lies in the significant variability in the structure and inherent properties of the 2D and 3D data collections, which hinders cross-domain analysis and exploration. We introduce CrossLink, a system for joint image-3D model processing that uses the complementary strengths of each data modality to facilitate analysis and exploration. We first show how our system significantly improves the quality of text-based 3D model search by using side information coming from an image database. We then demonstrate how to consistently align the filtered 3D model collections, and then use them to re-sort image collections based on pose and shape attributes. We evaluate our framework both quantitatively and qualitatively on 20 object categories of 2D image and 3D model collections, and quantitatively demonstrate how a wide variety of tasks in each data modality can strongly benefit from the complementary information present in the other, paving the way to a richer 2D and 3D processing toolbox.
Starting Page	1
Ending Page	13
Page Count	13
File Format	PDF
ISSN	07300301
e-ISSN	15577368
DOI	10.1145/2816795.2818097
Volume Number	34
Issue Number	6
Journal	ACM Transactions on Graphics (TOG)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2015-10-26
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Image search Model collections Pose estimation Shape analysis Shape variations
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

CROSSLINK: Joint Understanding of Image and 3D Model Collections through Shape and Camera Pose Variations

CROSSLINK: Joint Understanding of Image and 3D Model Collections through Shape and Camera Pose Variations

Estimating image depth using shape collections

Exploring collections of 3D models using fuzzy correspondences

Single-view reconstruction via joint analysis of image and shape collections

Exploration of continuous variability in collections of 3D shapes

Learning part-based templates from large collections of 3D shapes

A scalable active framework for region annotation in 3D shape collections

Context-based search for 3D models

CrossLink: joint understanding of image and 3D model collections through shape and camera pose variations

Similar Documents

CROSSLINK: Joint Understanding of Image and 3D Model Collections through Shape and Camera Pose Variations

CROSSLINK: Joint Understanding of Image and 3D Model Collections through Shape and Camera Pose Variations

Estimating image depth using shape collections

Exploring collections of 3D models using fuzzy correspondences

Single-view reconstruction via joint analysis of image and shape collections

Exploration of continuous variability in collections of 3D shapes

Learning part-based templates from large collections of 3D shapes

A scalable active framework for region annotation in 3D shape collections

Context-based search for 3D models

CrossLink: joint understanding of image and 3D model collections through shape and camera pose variations