NDLI: Predicting durability in DHTs using Markov chains

Content Provider	IEEE Xplore Digital Library
Author	Picconi, Fabio Baynat, Bruno Sens, Pierre
Copyright Year	2007
Description	Author affiliation: LIP6/Inria, Paris, France (Sens, Pierre) \|\| University of Bologna, Italy (Picconi, Fabio) \|\| LIP6, Paris, France (Baynat, Bruno)
Abstract	We consider the problem of data durability in low-bandwidth large-scale distributed storage systems. Given the limited bandwidth between replicas, these systems suffer from long repair times after a hard disk crash, making them vulnerable to data loss when several replicas fail within a short period of time. Recent work has suggested that the probability of data loss can be predicted by modeling the number of live replicas using a Markov chain. This, in turn, can then be used to determine the number of replicas necessary to keep the loss probability under a given desired value. Previous authors have suggested that the model parameters can be estimated using an expression that is constant or linear on the number of replicas. Our simulations, however, show that neither is correct, as these parameter values grow sublinearly with the number of replicas. Moreover, we show that using a linear expression will result in the probability of data loss being underestimated, while the constant expression will produce a significant overestimation. Finally, we provide an empirical expression that yields a good approximation of the sublinear parameter values. Our work can be viewed as a first step towards finding more accurate models to predict the durability of this type of systems.
Starting Page	532
Ending Page	538
File Size	346840
Page Count	7
File Format	PDF
ISBN	9781424414758
DOI	10.1109/ICDIM.2007.4444278
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2007-10-28
Publisher Place	France
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Storage area networks Network servers Parameter estimation Costs Operating systems Bandwidth Predictive models Hard disks Computer crashes Large-scale systems
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

SAN Optimal Multi Parameter Access Scheme

Predicting durability in dhts using markov chains.

Increasing hard drive performance — from a thermal perspective

A research on multi-level networked RAID based on cluster architecture

Impact of failure on interconnection networks for large storage systems

Analysis of multiple target network storage access using multi-routing VPN connections

Multiple Micro Virtual Disks for Constructing Large-scale Storage

Performance virtualization for large-scale storage systems

An efficient and bandwidth sensitive parallel download scheme in data grids

Predicting durability in DHTs using Markov chains

Similar Documents

SAN Optimal Multi Parameter Access Scheme

Predicting durability in dhts using markov chains.

Increasing hard drive performance — from a thermal perspective

A research on multi-level networked RAID based on cluster architecture

Impact of failure on interconnection networks for large storage systems

Analysis of multiple target network storage access using multi-routing VPN connections

Multiple Micro Virtual Disks for Constructing Large-scale Storage

Performance virtualization for large-scale storage systems

An efficient and bandwidth sensitive parallel download scheme in data grids

Predicting durability in DHTs using Markov chains