NDLI: In-Situ Bitmaps Generation and Efficient Data Analysis based on Bitmaps

Please wait, while we are loading the content...

Through the Looking-Glass: From Performance Observation to Dynamic Adaptation

Turning Centralized Coherence and Distributed Critical-Section Execution on their Head: A New Approach for Scalable Distributed Shared Memory

A Multiplatform Study of I/O Behavior on Petascale Supercomputers

Automated Characterization of Parallel Application Communication Patterns

High Impact Computing: Computing for Science and the Science of Computing

Practical Resource Management in Power-Constrained, High Performance Computing

Achieving Performance Isolation with Lightweight Co-Kernels

Bidding for Highly Available Services with Low Price in Spot Instance Market

HeteroDoop: A MapReduce Programming System for Accelerator Clusters

Uni-Address Threads: Scalable Thread Management for RDMA-Based Work Stealing

CAST: Tiering Storage for Data Analytics in the Cloud

Cache Line Aware Optimizations for ccNUMA Systems

Optimizing Grouped Aggregation in Geo-Distributed Streaming Analytics

Accelerating Irregular Computations with Hardware Transactional Memory and Active Messages

Planning and Optimization in TORQUE Resource Manager

Monte Carlo Based Ray Tracing in CPU-GPU Heterogeneous Systems and Applications in Radiation Therapy

A Case for Transforming Parallel Runtimes Into Operating System Kernels

HPC System Lifetime Story: Workload Characterization and Evolutionary Analyses on NERSC Systems

XEMEM: Efficient Shared Memory for Composed Applications on Multi-OS/R Exascale Systems

POW: System-wide Dynamic Reallocation of Limited Power in HPC

Understanding Graph Computation Behavior to Enable Robust Benchmarking

Cutting the Cost of Hosting Online Services Using Cloud Spot Markets

Automated GPU Kernel Transformations in Large-Scale Production Stencil Applications

In-Situ Bitmaps Generation and Efficient Data Analysis based on Bitmaps

Transit: A Visual Analytical Model for Multithreaded Machines

Fast Iterative Graph Computation with Resource Aware Graph Parallel Abstractions

Towards Scalable Distributed Workload Manager with Monitoring-Based Weakly Consistent Resource Stealing

A Numerical Soft Fault Model for Iterative Linear Solvers

DARE: High-Performance State Machine Replication on RDMA Networks

A Declarative Optimization Engine for Resource Provisioning of Scientific Workflows in IaaS Clouds

Lightweight Silent Data Corruption Detection Based on Runtime Data Analysis for HPC Applications

Exploring Failure Recovery for Stencil-based Applications at Extreme Scales

In-Situ Bitmaps Generation and Efficient Data Analysis based on Bitmaps

Content Provider	ACM Digital Library
Author	Su, Yu Wang, Yi Agrawal, Gagan
Abstract	Neither the memory capacity, memory access speeds, nor disk bandwidths are increasing at the same rate as the computing power in current and upcoming parallel machines. This has led to considerable recent research on in-situ data analytics. However, many open questions remain on how to perform such analytics, especially in memory constrained systems. Building on our earlier work that demonstrated bitmap indices (bitmaps) can be a suitable summary structure for key (offline) analytics tasks, this paper develops an in-situ analysis approach that performs data reduction (such as time-steps selection) using just bitmaps, and subsequently, stores only the selected bitmaps for post-analysis. We construct compressed bitmaps on the fly, show that many kinds of in-situ analyses can be supported by bitmaps without requiring the original data (and thus reducing memory requirements for in-situ analysis), and instead of writing the original simulation output, we only write the selected bitmaps to the disks (reducing the I/O requirements). We also demonstrate that we are able to use bitmaps for key offline analysis steps. We extensively evaluate our method with different simulations and applications, and demonstrate the effectiveness of our approach.
Starting Page	61
Ending Page	72
Page Count	12
File Format	PDF
ISBN	9781450335508
DOI	10.1145/2749246.2749268
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2015-06-15
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Correlation analysis Bitmaps In-situ analysis Time-steps selection Data reduction
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Compressed Bitmaps Based Frequent Itemsets Mining on Hadoop

Efficient content-based indexing of sequential data with bitmaps

A method for feature selection based on the correlation analysis

A New Seismic Data De-Noising Method Based on Wavelet Transform

Energy-Efficient Data Gathering Using Traffic Reduction Based on Change in Data Characteristics in Wireless Sensor Networks

The Research of Data Mining Analysis System Based on Pearson Relation

Matrix-based visual correlation analysis on large timeseries data

Fault prediction for power system based on multidimensional time series correlation analysis

A novel knowledge reduction method based on rank correlation analysis

In-Situ Bitmaps Generation and Efficient Data Analysis based on Bitmaps

Similar Documents

Compressed Bitmaps Based Frequent Itemsets Mining on Hadoop

Efficient content-based indexing of sequential data with bitmaps

A method for feature selection based on the correlation analysis

A New Seismic Data De-Noising Method Based on Wavelet Transform

Energy-Efficient Data Gathering Using Traffic Reduction Based on Change in Data Characteristics in Wireless Sensor Networks

The Research of Data Mining Analysis System Based on Pearson Relation

Matrix-based visual correlation analysis on large timeseries data

Fault prediction for power system based on multidimensional time series correlation analysis

A novel knowledge reduction method based on rank correlation analysis

In-Situ Bitmaps Generation and Efficient Data Analysis based on Bitmaps