NDLI: Block locality caching for data deduplication

Please wait, while we are loading the content...

HSG-LM: hybrid-copy speculative guest OS live migration without hypervisor

Examining extended and scientific metadata for scalable index designs

Computational caches

HEC: improving endurance of high performance flash-based cache devices

Fuzzy adaptive control for heterogeneous tasks in high-performance storage systems

Virtual point in time access

Beyond block I/O: implementing a distributed shared log in hardware

Fighting internet-based sexual exploitation crimes against children

Octopus: efficient data intensive computing on virtualized datacenters

Direct lookup and hash-based metadata placement for local file systems

Extending SSD lifetime in database applications with page overwrites

Rangoli: space management in deduplication environments

Performance introspection of graph databases

Linux block IO: introducing multi-queue SSD access on multi-core systems

Spanner: Google's globally-distributed database

Mercury: bringing efficiency to key-value stores

An empirical study of hot/cold data separation policies in solid state drives (SSDs)

Block locality caching for data deduplication

Leveraging predefined huffman dictionaries for high compression rate and ratio

Big data: little software?

A self-managed self-optimized publish-subscribe system

A scalable deduplication and garbage collection engine for incremental backup

Building intelligence for software defined data centers: modeling usage patterns

Block locality caching for data deduplication

Content Provider	ACM Digital Library
Author	Brinkmann, André Kaiser, Jürgen Meister, Dirk
Abstract	Data deduplication systems discover and remove redundancies between data blocks by splitting the data stream into chunks and comparing a hash of each chunk with all previously stored hashes. Storing the corresponding chunk index on hard disks immediately limits the achievable throughput, as these devices are unable to support the high number of random IOs induced by this index. Several approaches to overcome this chunk lookup disk bottleneck have been proposed. Often, the approaches try to capture the locality information of a backup run and use this in the next backup run to predict future chunk requests. However, often this locality is only captured by a surrogate, e.g., the order of the chunks in containers. [37]. Furthermore, some approaches degenerate slowly when the systems operate over months and years because the locality information becomes outdated. We propose a novel approach, called Block Locality Cache (BLC), that captures the previous backup run significantly better than existing approaches and also always uses up-to-date locality information and which is, therefore, less prone to aging. We evaluate the approach using a trace-based simulation of multiple real-world backup datasets. The simulation compares the Block Locality Cache with the approach of Zhu et al. [37] and provides a detailed analysis of the behavior and IO pattern. Furthermore, a prototype implementation is used to validate the simulation.
Starting Page	1
Ending Page	12
Page Count	12
File Format	PDF
ISBN	9781450321167
DOI	10.1145/2485732.2485748
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2013-06-30
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Backup Disk bottleneck Data deduplication
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Sampling and locality.

Leverage similarity and locality to enhance fingerprint prefetching of data deduplication

Extreme binning: Scalable, parallel deduplication for chunk-based file backup (2009)

http://www.ssrc.ucsc.edu / HANDS: A Heuristically Arranged Non-Backup In-line (2012)

Exploiting Fingerprint Prefetching to Improve the Performance of Data Deduplication

Avoiding the disk bottleneck in the data domain deduplication file system (2008)

iDedup: Latency-aware, inline data deduplication for primary storage (2012)

iDedup: Latency-aware, inline data deduplication for primary storage (2012)

BACKUP STORAGE BLOCK-LEVEL DEDUPLICATION WITH DDUMBFS AND BACULA

Block locality caching for data deduplication

Similar Documents

Sampling and locality.

Leverage similarity and locality to enhance fingerprint prefetching of data deduplication

Extreme binning: Scalable, parallel deduplication for chunk-based file backup (2009)

http://www.ssrc.ucsc.edu / HANDS: A Heuristically Arranged Non-Backup In-line (2012)

Exploiting Fingerprint Prefetching to Improve the Performance of Data Deduplication

Avoiding the disk bottleneck in the data domain deduplication file system (2008)

iDedup: Latency-aware, inline data deduplication for primary storage (2012)

iDedup: Latency-aware, inline data deduplication for primary storage (2012)

BACKUP STORAGE BLOCK-LEVEL DEDUPLICATION WITH DDUMBFS AND BACULA

Block locality caching for data deduplication