NDLI: Rangoli: space management in deduplication environments

Please wait, while we are loading the content...

HSG-LM: hybrid-copy speculative guest OS live migration without hypervisor

Examining extended and scientific metadata for scalable index designs

Computational caches

HEC: improving endurance of high performance flash-based cache devices

Fuzzy adaptive control for heterogeneous tasks in high-performance storage systems

Virtual point in time access

Beyond block I/O: implementing a distributed shared log in hardware

Fighting internet-based sexual exploitation crimes against children

Octopus: efficient data intensive computing on virtualized datacenters

Direct lookup and hash-based metadata placement for local file systems

Extending SSD lifetime in database applications with page overwrites

Rangoli: space management in deduplication environments

Performance introspection of graph databases

Linux block IO: introducing multi-queue SSD access on multi-core systems

Spanner: Google's globally-distributed database

Mercury: bringing efficiency to key-value stores

An empirical study of hot/cold data separation policies in solid state drives (SSDs)

Block locality caching for data deduplication

Leveraging predefined huffman dictionaries for high compression rate and ratio

Big data: little software?

A self-managed self-optimized publish-subscribe system

A scalable deduplication and garbage collection engine for incremental backup

Building intelligence for software defined data centers: modeling usage patterns

Rangoli: space management in deduplication environments

Content Provider	ACM Digital Library
Author	Nagesh, P. C. Kathpal, Atish
Abstract	Space management is the activity of monitoring and ensuring adequate free space on all volumes in a clustered storage system. Volumes that exceed used space limits are typically relieved by migrating a part of their data to other under utilized volumes. Without deduplication, space reclamation is simple as one has to just migrate as much data as the desired space reclamation. However, in deduped volumes there is no direct relation between the logical size of the file and the physical space occupied by it. Therefore, optimal space reclamation is hard as: a)migrating few files may produce little or zero bytes of free space, but still incur significant network costs. b)migrating a heavily shared file destroys the disk sharing relationships in that volume and increases the physical space consumption of that dataset. In this work, we have designed and built a fast and efficient tool Rangoli, that identifies the optimal set of files for space reclamation in a deduped environment. It can scale to millions of files and terabytes of data, running in tens of minutes. We show by experimenting on real world datasets, that alternate strategies such as those based on finding unique files or using MinHash, impact physical space consumption by a wide margin (up to 35 times) as compared to Rangoli.
Starting Page	1
Ending Page	6
Page Count	6
File Format	PDF
ISBN	9781450321167
DOI	10.1145/2485732.2485744
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2013-06-30
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Capacity balancing Space management
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Improving storage capacity by distributed exact deduplication systems

Singleton: system-wide page deduplication in virtual environments

Catalyst: GPU-assisted rapid memory deduplication in virtualization environments

Secure data deduplication

A Memory Deduplication Approach Based on Group in Virtualized Environments

Parameterization of Indian Traditional Rangoli Design Patterns

Fast Memory Deduplication of Disk Cache Pages in Virtual Environments

Dynamic load management for MMOGs in distributed environments

Dynamic Resource Management in Cloud-based Distributed Virtual Environments

Rangoli: space management in deduplication environments

Similar Documents

Improving storage capacity by distributed exact deduplication systems

Singleton: system-wide page deduplication in virtual environments

Catalyst: GPU-assisted rapid memory deduplication in virtualization environments

Secure data deduplication

A Memory Deduplication Approach Based on Group in Virtualized Environments

Parameterization of Indian Traditional Rangoli Design Patterns

Fast Memory Deduplication of Disk Cache Pages in Virtual Environments

Dynamic load management for MMOGs in distributed environments

Dynamic Resource Management in Cloud-based Distributed Virtual Environments

Rangoli: space management in deduplication environments