NDLI: Hierarchical codes: A flexible trade-off for erasure codes in peer-to-peer storage systems

Please wait, while we are loading the content...

Hierarchical codes: A flexible trade-off for erasure codes in peer-to-peer storage systems

Content Provider	Springer Nature Link
Author	Duminuco, Alessandro Biersack, Ernst W.
Copyright Year	2009
Abstract	Redundancy is the basic technique to provide reliability in storage systems consisting of multiple components. A redundancy scheme defines how the redundant data are produced and maintained. The simplest redundancy scheme is replication, which however suffers from storage inefficiency. Another approach is erasure coding, which provides the same level of reliability as replication using a significantly smaller amount of storage. When redundant data are lost, they need to be replaced. While replacing replicated data consists in a simple copy, it becomes a complex operation with erasure codes: new data are produced performing a coding over some other available data. The amount of data to be read and coded is d times larger than the amount of data produced, where d, called repair degree, is larger than 1 and depends on the structure of the code. This implies that coding has a larger computational and I/O cost, which, for distributed storage systems, translates into increased network traffic. Participants of Peer-to-Peer systems often have ample storage and CPU power, but their network bandwidth may be limited. For these reasons existing coding techniques are not suitable for P2P storage. This work explores the design space between replication and the existing erasure codes. We propose and evaluate a new class of erasure codes, called Hierarchical Codes, which allows to reduce the network traffic due to maintenance without losing the benefits given by traditional erasure codes.
Starting Page	52
Ending Page	66
Page Count	15
File Format	PDF
ISSN	19366442
Journal	Peer-to-Peer Networking and Applications
Volume Number	3
Issue Number	1
e-ISSN	19366450
Language	English
Publisher	Springer US
Publisher Date	2009-04-22
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Peer-to-peer Storage Erasure codes Reliability Dependability Signal, Image and Speech Processing Computer Communication Networks Information Systems and Communication Service Communications Engineering, Networks
Content Type	Text
Resource Type	Article
Subject	Computer Networks and Communications Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Editorial: Special issue on dependable peer-to-peer systems

Multifactor hierarchical fuzzy trust evaluation on peer-to-peer networks

Self-nominating trust model based on hierarchical fuzzy systems for peer-to-peer networks

Peer-to-peer as an infrastructure service

Hierarchical architectures in structured peer-to-peer overlay networks

Peer-to-peer systems for video delivery

Delay and playout probability trade-off in mesh-based peer-to-peer streaming with delayed buffer map updates

Experimental evaluation of peer-to-peer applications

Peer-to-peer in big data management

Hierarchical codes: A flexible trade-off for erasure codes in peer-to-peer storage systems

Similar Documents

Editorial: Special issue on dependable peer-to-peer systems

Multifactor hierarchical fuzzy trust evaluation on peer-to-peer networks

Self-nominating trust model based on hierarchical fuzzy systems for peer-to-peer networks

Peer-to-peer as an infrastructure service

Hierarchical architectures in structured peer-to-peer overlay networks

Peer-to-peer systems for video delivery

Delay and playout probability trade-off in mesh-based peer-to-peer streaming with delayed buffer map updates

Experimental evaluation of peer-to-peer applications

Peer-to-peer in big data management

Hierarchical codes: A flexible trade-off for erasure codes in peer-to-peer storage systems