NDLI: Exploiting Correlation and Parallelism of Materialized-View Recommendation for Distributed Data Warehouses

Content Provider	IEEE Xplore Digital Library
Author	Haifeng Jiang Dengfeng Gao Wen-Syan Li
Copyright Year	2007
Description	Author affiliation: IBM Almaden Res. Center, San Jose, CA, USA (Haifeng Jiang; Dengfeng Gao; Wen-Syan Li)
Abstract	Many large enterprises require access to distributed data warehouses for business intelligence (BI) applications. Typically distributed data warehouses are integrated into a centralized data warehouse for the benefit of easy maintenance. However, this approach needs to overcome the complexity of data loading and job scheduling as well as scalability issues. On the other hand, the approach of a fully federated system may not be feasible for data intensive BI applications. The hybrid approach via intelligent data placement is more flexible and applicable than the centralized or full-federation configuration. The current implementation of the hybrid approach to integrating distributed data warehouses is to aggregate selected data from various remote sources as materialized views and cache them at the federation server to improve the performance of complex BI query workloads. In this paper, we propose an improvement that recommends materialized query tables (MQTs) for backend servers for the benefits of load distribution and easy maintenance of aggregated data in conjunction with the current hybrid approach of data placement. Our approach considers the correlation between backend servers and recommends MQTs that are well coordinated among the backend servers and optimized for a given workload. We also exploit the parallelism property among the backend servers to make our approach run almost linearly (in contrast to exponentially) with respect to the number of backend servers, without sacrificing its recommendation quality. Experimental evaluations validate the effectiveness and efficiency of our approach.
Starting Page	276
Ending Page	285
File Size	219120
Page Count	10
File Format	PDF
ISBN	1424408024
DOI	10.1109/ICDE.2007.367873
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2006-04-15
Publisher Place	Turkey
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Data warehouses Bismuth Iron Databases Scalability Aggregates Data models Web services Statistics Cost function
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Materialized view design and maintenance in a financial data warehouse system

Data warehouse enhancement manipulating materialized view hierarchy

A maintainable model of materialized view based on data warehouse

Research on Materialized Views Technology in Data Warehouse

The Opsis Project: Materialized Views for Data Warehouses and the Web

Materialized view size estimation using sampling

Cost Optimisation for Distributed Data Warehouses

An Incremental View Maintenance Approach Using Version Store in Warehousing Environment

An Architecture to Maintain Materialized View in Cloud Computing Environment for OLAP Processing

Exploiting Correlation and Parallelism of Materialized-View Recommendation for Distributed Data Warehouses

Similar Documents

Materialized view design and maintenance in a financial data warehouse system

Data warehouse enhancement manipulating materialized view hierarchy

A maintainable model of materialized view based on data warehouse

Research on Materialized Views Technology in Data Warehouse

The Opsis Project: Materialized Views for Data Warehouses and the Web

Materialized view size estimation using sampling

Cost Optimisation for Distributed Data Warehouses

An Incremental View Maintenance Approach Using Version Store in Warehousing Environment

An Architecture to Maintain Materialized View in Cloud Computing Environment for OLAP Processing

Exploiting Correlation and Parallelism of Materialized-View Recommendation for Distributed Data Warehouses