NDLI: HyDB: Access Optimization for Data-Intensive Service

Content Provider	IEEE Xplore Digital Library
Author	Qing Zhu Zuoyan Qin
Copyright Year	2012
Abstract	With the explosive growth of big data, data-intensive analysis services need a large data storage and high efficient parallel query processing techniques in cloud using lower-end machines, because most organizations adopt inexpensive low-end clusters. A key challenge is to optimize query processing in such a cloud environment. In this paper, we present a new hybrid data access architecture, called HyDB, for providing data-intensive analysis services, which is featured with a distributed data storage, parallel data access, and query optimization methods. First, we propose a new data partitioning method based on both workloads and co-located resources. The data partitioning method achieves higher consolidation and outperforms the existing approaches. Second, we provide a new parallel access method which includes parallel query processing, optimal query plan generation, and optimal path selection by using a plan tree pruning technique. We have implemented HyDB. Finally, we conduct extensive experimental studies and confirm the efficiency of our HyDB.
Starting Page	580
Ending Page	587
File Size	531999
Page Count	8
File Format	PDF
ISBN	9781467321648
DOI	10.1109/HPCC.2012.84
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-06-25
Publisher Place	United Kingdom
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	database data partition query optimization Query processing Peer to peer computing Redundancy Distributed databases Marketing and sales Engines data intensive service MapReduce
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

DBNet: A Service-Oriented Database Architecture

Application of Hadoop MapReduce technique to Virtual Database system design

Query planning in P2P database systems

Assessing MapReduce for Internet Computing: A Comparison of Hadoop and BitDew-MapReduce

Research on access of relational database

The OLAP-Enabled Grid: Model and Query Processing Algorithms

Distributed Query Processing in an Ad-hoc Semantic Web Data Sharing System

PADIA: P2P-Based Adaptive Data Integration Architecture

Sideways Information Passing for Push-Style Query Processing

HyDB: Access Optimization for Data-Intensive Service

Similar Documents

DBNet: A Service-Oriented Database Architecture

Application of Hadoop MapReduce technique to Virtual Database system design

Query planning in P2P database systems

Assessing MapReduce for Internet Computing: A Comparison of Hadoop and BitDew-MapReduce

Research on access of relational database

The OLAP-Enabled Grid: Model and Query Processing Algorithms

Distributed Query Processing in an Ad-hoc Semantic Web Data Sharing System

PADIA: P2P-Based Adaptive Data Integration Architecture

Sideways Information Passing for Push-Style Query Processing

HyDB: Access Optimization for Data-Intensive Service