NDLI: Communication cost optimization for cloud Data Warehouse queries

Content Provider	IEEE Xplore Digital Library
Author	Kurunji, S. Tingjian Ge Benyuan Liu Chen, C.X.
Copyright Year	2012
Description	Author affiliation: Computer Science Department University of Massachusetts Lowell Lowell, Massachusetts, USA (Kurunji, S.; Tingjian Ge; Benyuan Liu; Chen, C.X.)
Abstract	Read-Optimized databases are well suited for read intensive Data Warehouse applications. In addition, data in these applications grow rapidly and hence need a dynamically scalable environment like Cloud. Cloud provides a flexible environment where user can load data, execute queries and scale resources on demand. However, cloud has its own challenges. To reduce the inter-node communication during the execution of query, tables are horizontally partitioned on join attribute and then related partitions are stored on the same physical system. In cloud environment it is not possible to ensure that these related partitions are always stored on the same physical system. As the resources are scaled up, the number of nodes involved increases, resulting in the increased inter-node communication. This becomes critical when we have huge data (in Tera or Peta bytes) stored across a large number of nodes. So with the increase in number of nodes and data size, the communication message size increases. All these factors result in increased bandwidth usage and performance degradation. When the number of joins in a query increases, the performance will further degrade. These problems emphasize a need for good storage structure and query execution plan. In this paper we propose a storage structure PK-map and a query processing algorithm. We show, through experiments, that this approach not only decreases the inter-node communication overhead but also decreases the work load of joins.
Starting Page	512
Ending Page	519
File Size	971346
Page Count	8
File Format	PDF
ISBN	9781467345118
e-ISBN	9781467345101
e-ISBN	9781467345095
DOI	10.1109/CloudCom.2012.6427580
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-12-03
Publisher Place	Taiwan
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Query Optimization Cloud computing Query processing Conferences Communication Cost Distributed databases Data warehouses Data Warehouse Multi-join Query Indexes Cloud Strorage Read-Optimized Database
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Multi-join query optimization for read-optimized data warehouse in a cloud environment.

2012 ieee 4th international conference on cloud computing technology and science communication cost optimization for cloud data warehouse queries.

Study of query of distributed database based on relation semi join

Presenting a New Method for Optimizing Join Queries Processing in Heterogeneous Distributed Databases

Using combination of join and semijoin operations for distributed query processing

Spatial Join Query Processing in Cloud: Analyzing Design Choices and Performance Comparisons

MapReduce model-based optimization of range queries

Implementing Joins over HBase on Cloud Platform

Query's optimization in data warehouse on the cloud using fragmentation

Communication cost optimization for cloud Data Warehouse queries

Similar Documents

Multi-join query optimization for read-optimized data warehouse in a cloud environment.

2012 ieee 4th international conference on cloud computing technology and science communication cost optimization for cloud data warehouse queries.

Study of query of distributed database based on relation semi join

Presenting a New Method for Optimizing Join Queries Processing in Heterogeneous Distributed Databases

Using combination of join and semijoin operations for distributed query processing

Spatial Join Query Processing in Cloud: Analyzing Design Choices and Performance Comparisons

MapReduce model-based optimization of range queries

Implementing Joins over HBase on Cloud Platform

Query's optimization in data warehouse on the cloud using fragmentation

Communication cost optimization for cloud Data Warehouse queries