NDLI: On adaptive distributed storage systems

Content Provider	IEEE Xplore Digital Library
Author	Rai, B.K. Dhoorjati, V. Saini, L. Jha, A.K.
Copyright Year	2015
Description	Author affiliation: Dept. of Electron. & Electr. Eng., Indian Inst. of Technol. Guwahati, Guwahati, India (Rai, B.K.; Dhoorjati, V.; Saini, L.; Jha, A.K.)
Abstract	In a distributed storage system (DSS), high data reliability is obtained by dispersing the data over a number of nodes over a network. In an (n, k) erasure code based DSS, a data file is first divided into k packets and then these k packets are encoded into n packets using an MDS code, and finally these n packets are distributed over n nodes so that each node stores one encoded packet. A fixed value of n and k provides certain level of reliability (an (n, k) erasure code based DSS can tolerate n - k node failures) and costs certain storage space. Considering the storage cost and required reliability, we might require to change an existing (n, k) erasure code based DSS to an (n', k') erasure code based DSS. However, for converting an (n, k) erasure code based DSS into an (n', k') erasure code based DSS, a naive way would be to to download the whole data, re-encode, and disperse the encoded data again. In practical situations, where we have huge amount of data, this process requires huge download bandwidth and thus it is not appreciable. In this paper, we present adaptive coding schemes for erasure code based DSS to adapt to another parameters with the minimum amount of data download. We first introduce a repair scheme for the partially failed nodes in a DSS by downloading the minimum amount of data. The concept of repairing partially failed nodes might be of independent interest. In most cases, our adaptive coding schemes view the problem of converting an (n, k) erasure code based DSS into an (n', k') erasure code based DSS with the minimum download as an instance of the repairing scheme of partially failed nodes in a DSS with the minimum download.
Starting Page	1482
Ending Page	1486
File Size	231612
Page Count	5
File Format	PDF
ISSN	21578117
e-ISBN	9781467377041
DOI	10.1109/ISIT.2015.7282702
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-06-14
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Decision support systems Maintenance engineering Reliability Encoding Distributed databases Cloud computing Network coding
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

An eavesdropping prevention problem when repairing network coded data from remote distributed storage

On adaptive (functional MSR code based) distributed storage systems

Adaptive erasure code based distributed storage systems

An update model for network coding in cloud storage systems

Node recovery schemes for minimizing repair time in distributed storage system with network coding

Synchronizing edits in distributed storage networks

The fundamental theorem of distributed storage systems revisited

LT codes-based secure and reliable cloud storage service

On block security of regenerating codes at the MBR point for distributed storage systems

On adaptive distributed storage systems

Similar Documents

An eavesdropping prevention problem when repairing network coded data from remote distributed storage

On adaptive (functional MSR code based) distributed storage systems

Adaptive erasure code based distributed storage systems

An update model for network coding in cloud storage systems

Node recovery schemes for minimizing repair time in distributed storage system with network coding

Synchronizing edits in distributed storage networks

The fundamental theorem of distributed storage systems revisited

LT codes-based secure and reliable cloud storage service

On block security of regenerating codes at the MBR point for distributed storage systems

On adaptive distributed storage systems