NDLI: Haggis: turbocharge a MapReduce based spatial data warehousing system with GPU engine

Please wait, while we are loading the content...

A computational framework for ontologically storing and analyzing very large overhead image sets

High performance integrated spatial big data analytics

Haggis: turbocharge a MapReduce based spatial data warehousing system with GPU engine

A computational framework for finding interestingness hotspots in large spatio-temporal grids

Parallel QuadTree encoding of large-scale raster geospatial data on multicore CPUs and GPGPUs

Partitioning strategies for spatio-textual similarity join

A MapReduce algorithm to create contiguity weights for spatial analysis of big data

An efficient GPU multiple-observer siting method based on sparse-matrix multiplication

Haggis: turbocharge a MapReduce based spatial data warehousing system with GPU engine

Content Provider	ACM Digital Library
Author	Aji, Ablimit Teodoro, George Wang, Fusheng
Abstract	Spatial query processing involves complex multidimensional objects and compute intensive spatial operations, and therefore requires a high performance approach to meet the rapid data analytics requirements of modern spatial applications. Recently, MapReduce based spatial query systems have become a viable solution for many data intensive query tasks, and gained widespread adoption in both academia and industry. At the same time, GPUs have been successfully utilized in many applications that require high performance computation. Both approaches, GPU and MapReduce, have their own limitations and advantages, and have been separately utilized in spatial query processing tasks to boost application performance. However, it is unclear that how MapReduce and GPU, two vastly different parallelization techniques, can be fused together to effectively deal with the spatial big data challenges. In this paper, we explore such synergy of parallelization techniques for large scale spatial query processing. We extend Hadoop-GIS, a MapReduce based spatial query system, and provide GPU accelerated spatial query processing capability at the engine level. We evaluate the system on a real world dataset, and demonstrate that GPU accelerated system can gain considerable performance improvements. We also show how other factors such as partition granularity, task scheduling between CPU and GPU can impact the query performance.
Starting Page	15
Ending Page	20
Page Count	6
File Format	PDF
ISBN	9781450331326
DOI	10.1145/2676536.2676539
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2014-11-04
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Spatial query processing Mapreduce Load balancing Gpu Spatial data partition
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in