NDLI: Data Replication in Data Intensive Scientific Applications with Performance Guarantee

Content Provider	IEEE Xplore Digital Library
Author	Nukarapu, D.T. Bin Tang Liqiang Wang Shiyong Lu
Copyright Year	1990
Abstract	Data replication has been well adopted in data intensive scientific applications to reduce data file transfer time and bandwidth consumption. However, the problem of data replication in Data Grids, an enabling technology for data intensive applications, has proven to be NP-hard and even non approximable, making this problem difficult to solve. Meanwhile, most of the previous research in this field is either theoretical investigation without practical consideration, or heuristics-based with little or no theoretical performance guarantee. In this paper, we propose a data replication algorithm that not only has a provable theoretical performance guarantee, but also can be implemented in a distributed and practical manner. Specifically, we design a polynomial time centralized replication algorithm that reduces the total data file access delay by at least half of that reduced by the optimal replication solution. Based on this centralized algorithm, we also design a distributed caching algorithm, which can be easily adopted in a distributed environment such as Data Grids. Extensive simulations are performed to validate the efficiency of our proposed algorithms. Using our own simulator, we show that our centralized replication algorithm performs comparably to the optimal algorithm and other intuitive heuristics under different network parameters. Using GridSim, a popular distributed Grid simulator, we demonstrate that the distributed caching technique significantly outperforms an existing popular file caching technique in Data Grids, and it is more scalable and adaptive to the dynamic change of file access patterns in Data Grids.
Sponsorship	IEEE Computer Society
Starting Page	1299
Ending Page	1306
Page Count	8
File Size	396818
File Format	PDF
ISSN	10459219
Volume Number	22
Issue Number	8
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2011-08-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Distributed databases Algorithm design and analysis Heuristic algorithms Data models Greedy algorithms Bandwidth Computational modeling simulations. Data intensive applications Data Grids data replication algorithm design and analysis
Content Type	Text
Resource Type	Article
Subject	Signal Processing Computational Theory and Mathematics Hardware and Architecture

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Round-based Data Replication Strategy

Data replication in data intensive scientific applications with performance guarantee

Improve the Performance of Data Grids by Value-Based Replication Strategy

A Distributed Algorithm for the Replica Placement Problem

On Traffic-Aware Partition and Aggregation in MapReduce for Big Data Applications

Heuristic algorithms for scheduling iterative task computations on distributed memory machines

The block distributed memory model

Asynchronous analysis of parallel dynamic programming algorithms

An iterative greedy algorithm for hardware/software partitioning

Data Replication in Data Intensive Scientific Applications with Performance Guarantee

Similar Documents

A Round-based Data Replication Strategy

Data replication in data intensive scientific applications with performance guarantee

Improve the Performance of Data Grids by Value-Based Replication Strategy

A Distributed Algorithm for the Replica Placement Problem

On Traffic-Aware Partition and Aggregation in MapReduce for Big Data Applications

Heuristic algorithms for scheduling iterative task computations on distributed memory machines

The block distributed memory model

Asynchronous analysis of parallel dynamic programming algorithms

An iterative greedy algorithm for hardware/software partitioning

Data Replication in Data Intensive Scientific Applications with Performance Guarantee