NDLI: ISOBAR Preconditioner for Effective and High-throughput Lossless Data Compression

Content Provider	IEEE Xplore Digital Library
Author	Schendel, E.R. Ye Jin Shah, N. Chen, J. Chang, C.S. Seung-Hoe Ku Ethier, S. Klasky, S. Latham, R. Ross, R. Samatova, N.F.
Copyright Year	2012
Abstract	Efficient handling of large volumes of data is a necessity for exascale scientific applications and database systems. To address the growing imbalance between the amount of available storage and the amount of data being produced by high speed (FLOPS) processors on the system, data must be compressed to reduce the total amount of data placed on the file systems. General-purpose loss less compression frameworks, such as zlib and bzlib2, are commonly used on datasets requiring loss less compression. Quite often, however, many scientific data sets compress poorly, referred to as hard-to-compress datasets, due to the negative impact of highly entropic content represented within the data. An important problem in better loss less data compression is to identify the hard-to-compress information and subsequently optimize the compression techniques at the byte-level. To address this challenge, we introduce the In-Situ Orthogonal Byte Aggregate Reduction Compression (ISOBAR-compress) methodology as a preconditioner of loss less compression to identify and optimize the compression efficiency and throughput of hard-to-compress datasets.
Starting Page	138
Ending Page	149
File Size	1093359
Page Count	12
File Format	PDF
ISBN	9781467300421
ISSN	10844627
e-ISBN	9780769547473
DOI	10.1109/ICDE.2012.114
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-04-01
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Arrays Throughput Standards Data models Equations Probability distribution Noise
Content Type	Text
Resource Type	Article
Subject	Signal Processing Information Systems Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Adaptive techniques for lossless data compression

Lossless data compression programmable hardware for high-speed data networks

Lossless coding standards for space data systems

An efficient adaptive arithmetic coding for block-based lossless image compression using mixture models

A Lossless Color Image Compression Algorithm with Adaptive Arithmetic Coding Based on Adjacent Data Probability

Fast and Efficient Compression of Floating-Point Data

Algorithms for Lossless Compression in Image Processing Systems

Kronecker product matrices for compressive sensing

A real-time algorithm for fixed-length short data compression

ISOBAR Preconditioner for Effective and High-throughput Lossless Data Compression

Similar Documents

Adaptive techniques for lossless data compression

Lossless data compression programmable hardware for high-speed data networks

Lossless coding standards for space data systems

An efficient adaptive arithmetic coding for block-based lossless image compression using mixture models

A Lossless Color Image Compression Algorithm with Adaptive Arithmetic Coding Based on Adjacent Data Probability

Fast and Efficient Compression of Floating-Point Data

Algorithms for Lossless Compression in Image Processing Systems

Kronecker product matrices for compressive sensing

A real-time algorithm for fixed-length short data compression

ISOBAR Preconditioner for Effective and High-throughput Lossless Data Compression