NDLI: Join Optimization in the MapReduce Environment for Column-wise Data Store

Content Provider	IEEE Xplore Digital Library
Author	Minqi Zhou Rong Zhang Dadan Zeng Weining Qian Aoying Zhou
Copyright Year	2010
Abstract	The chain join processing which combines records from two or more tables sequentially has been well studied in the centralized databases. However, it has seldom been discussed in the cloud computing era, and remains imperative to be solved, especially where structured (or relational) data are stored in a column (attribute) wise fashion in distributed file systems (e.g., Google File System) over hundreds of or even thousands of commodities PCs. In this paper, we propose a novel method for chain join processing, which is one of the common primitives in the cloud era for column-wise stored data analysis. By effectively selecting the dedicated records (tuples) for the chain join based on the information exploited within bipartite join graph, communication cost for record transmission could be reduced dramatically. A bushy tree structure is deployed to regulate the chain join sequence, which further reduces the number of intermediate results generated and transmitted, and explores higher parallelism in join processing, while results in more efficient join processing. Our extensive performance study confirms the effectiveness and efficiency of our methods.
Starting Page	97
Ending Page	104
File Size	530136
Page Count	8
File Format	PDF
ISBN	9781424481255
DOI	10.1109/SKG.2010.18
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-11-01
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Cloud computing Google Data analysis Distributed databases Bandwidth Parallel processing Bipartite graph
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Efficient Star Join for Column-oriented Data Store in the MapReduce Environment

MapReduce model-based optimization of range queries

Improving resource utilization in a heterogeneous cloud environment

Minimizing Data Transmission Latency by Bipartite Graph in MapReduce

Bipartite Matching Based Speculative Execution to Improve Cloud MapReduce Performance

Llama: leveraging columnar storage for scalable join processing in the MapReduce framework

A MapReduce-based approach for computing reachability preserving graph

An algorithm for resolving the join component selection problem in parallel join optimization

Novel Data-Distribution Technique for Hadoop in Heterogeneous Cloud Environments

Join Optimization in the MapReduce Environment for Column-wise Data Store

Similar Documents

Efficient Star Join for Column-oriented Data Store in the MapReduce Environment

MapReduce model-based optimization of range queries

Improving resource utilization in a heterogeneous cloud environment

Minimizing Data Transmission Latency by Bipartite Graph in MapReduce

Bipartite Matching Based Speculative Execution to Improve Cloud MapReduce Performance

Llama: leveraging columnar storage for scalable join processing in the MapReduce framework

A MapReduce-based approach for computing reachability preserving graph

An algorithm for resolving the join component selection problem in parallel join optimization

Novel Data-Distribution Technique for Hadoop in Heterogeneous Cloud Environments

Join Optimization in the MapReduce Environment for Column-wise Data Store