NDLI: Leveraging Human Computations to Improve Schematization of Spatial Relations from Imagery

Content Provider	ACM Digital Library
Author	Rao, Huaming Fu, Wai-Tat Huang, Shih-Wen
Copyright Year	2016
Abstract	The process of generating schematic maps of salient objects from a set of pictures of an indoor environment is challenging. It has been an active area of research as it is crucial to a wide range of context- and location-aware services, as well as for general scene understanding. Although many automated systems have been developed to solve the problem, most of them either require predefining labels or expensive equipment, such as RGBD sensors or lasers, to scan the environment. In this article, we introduce a prototype system to show how human computations can be utilized to generate schematic maps from a set of pictures, without making strong assumptions or demanding extra devices. The system requires humans (crowd workers from Amazon Mechanical Turks) to do simple spatial mapping tasks in various conditions, and their data are aggregated by filtering and clustering techniques that allow salient cues to be identified in the pictures and their spatial relations to be inferred and projected on a two-dimensional map. In particular, we tested and demonstrated the effectiveness of two methods that improved the quality of the generated schematic map: (1) We encouraged humans to adopt an allocentric representations of salient objects by guiding them to perform mental rotations of these objects and (2) we sensitized human perception by guided arrows superimposed on the imagery to improve the accuracy of depth and width estimation. We demonstrated the feasibility of our system by evaluating the results of schematic maps generated from indoor pictures taken from an office building. By calculating Riemannian shape distances between the generated maps to the ground truth, we found that the generated schematic maps captured the spatial relations well. Our results showed that the combination of human computations and machine clustering could lead to more-accurate schematized maps from imagery. We also discuss how our approach may have important insights on methods that leverage human computations in other areas.
Starting Page	1
Ending Page	21
Page Count	21
File Format	PDF
ISSN	21576904
e-ISSN	21576912
DOI	10.1145/2873065
Volume Number	7
Issue Number	4
Journal	ACM Transactions on Intelligent Systems and Technology (TIST)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2016-03-31
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Human computations Crowdsourcing Picture schematization Spatial cognition
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence Theoretical Computer Science

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Using targeted paraphrasing and monolingual crowdsourcing to improve translation

Towards a Crowd-based Picture Schematization System

Using the Crowd to Improve Search Result Ranking and the Search Experience

Spatial language and the psychological reality of schematization

Using Crowdsourcing for Scientific Analysis of Industrial Tomographic Images

Rapid Low-Cost Virtual Human Bootstrapping via the Crowd

Book announcement: Human Computation

Crowdsourcing Human Annotation on Web Page Structure: Infrastructure Design and Behavior-Based Quality Control

Incentives for Effort in Crowdsourcing Using the Peer Truth Serum

Leveraging Human Computations to Improve Schematization of Spatial Relations from Imagery

Similar Documents

Using targeted paraphrasing and monolingual crowdsourcing to improve translation

Towards a Crowd-based Picture Schematization System

Using the Crowd to Improve Search Result Ranking and the Search Experience

Spatial language and the psychological reality of schematization

Using Crowdsourcing for Scientific Analysis of Industrial Tomographic Images

Rapid Low-Cost Virtual Human Bootstrapping via the Crowd

Book announcement: Human Computation

Crowdsourcing Human Annotation on Web Page Structure: Infrastructure Design and Behavior-Based Quality Control

Incentives for Effort in Crowdsourcing Using the Peer Truth Serum

Leveraging Human Computations to Improve Schematization of Spatial Relations from Imagery